Jul 03 23:42:58 devstack cinder-volume[75410]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 03 23:42:58 devstack cinder-volume[75410]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 23:42:58 devstack cinder-volume[75410]: we strongly recommend against using it for new projects.
Jul 03 23:42:58 devstack cinder-volume[75410]: If you are already using Eventlet, we recommend migrating to a different
Jul 03 23:42:58 devstack cinder-volume[75410]: framework.  For more detail see
Jul 03 23:42:58 devstack cinder-volume[75410]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 23:42:58 devstack cinder-volume[75410]:   import eventlet  # noqa
Jul 03 23:43:00 devstack cinder-volume[75410]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75410) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 23:43:00 devstack cinder-volume[75410]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75410) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 23:43:00 devstack cinder-volume[75410]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75410) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 23:43:01 devstack cinder-volume[75410]: INFO dbcounter [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Registered counter for database cinder
Jul 03 23:43:01 devstack cinder-volume[75410]: DEBUG oslo_db.sqlalchemy.engines [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75410) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:43:01 devstack cinder-volume[75410]: DEBUG dbcounter [-] [75410] Writer thread running {{(pid=75410) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 23:43:01 devstack cinder-volume[75410]: INFO cinder.rpc [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 03 23:43:01 devstack cinder-volume[75410]: INFO cinder.rpc [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_db.sqlalchemy.engines [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75410) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:43:02 devstack cinder-volume[75410]: INFO cinder.volume.manager [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Determined volume DB was empty at startup.
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG cinder.volume.manager [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75410) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 03 23:43:02 devstack cinder-volume[75410]: INFO cinder.volume.manager [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 03 23:43:02 devstack cinder-volume[75410]: WARNING stevedore.named [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 23:43:02 devstack cinder-volume[75410]: WARNING castellan.key_manager [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 23:43:02 devstack cinder-volume[75410]: WARNING cinder.keymgr.conf_key_mgr [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG cinder.volume.drivers.lvm [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75410) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:110}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_concurrency.processutils [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75410) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_concurrency.processutils [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.468s {{(pid=75410) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_db.sqlalchemy.engines [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75410) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:43:02 devstack cinder-volume[75410]: INFO cinder.rpc [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 03 23:43:02 devstack cinder-volume[75410]: INFO cinder.rpc [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 03 23:43:02 devstack cinder-volume[75410]: WARNING stevedore.named [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 23:43:02 devstack cinder-volume[75410]: WARNING castellan.key_manager [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 23:43:02 devstack cinder-volume[75410]: INFO cinder.volume.manager [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_db.sqlalchemy.engines [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75410) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:43:02 devstack cinder-volume[75410]: INFO oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Starting 1 workers
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Started child 75578 {{(pid=75410) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Full set of CONF: {{(pid=75410) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] ******************************************************************************** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Configuration options gathered from: {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] ================================================================================ {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] allow_availability_zone_fallback = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] allow_compression_on_image_upload = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] allowed_direct_url_schemes     = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] api_rate_limit                 = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] auth_strategy                  = keystone {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] az_cache_duration              = 3600 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_availability_zone      = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_host                   = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_name                   = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_stats_polling_interval = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backup_api_class               = cinder.backup.api.API {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backup_name_template           = backup-%s {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backup_use_same_host           = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backup_use_temp_snapshot       = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75578]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] chap_password                  = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] chap_username                  =  {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cinder_internal_tenant_project_id = 157d44153e3443d0a283f0f3ed2fa3bd {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cinder_internal_tenant_user_id = f430159010d04fed8937ac8583e2634b {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cloned_volume_same_az          = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cluster                        = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] compression_format             = gzip {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] config_dir                     = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] config_source                  = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] control_exchange               = openstack {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] debug                          = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] default_availability_zone      = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] default_group_type             = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] default_volume_type            = lvmdriver-1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] disk_geometry                  = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] driver_client_cert             = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] driver_client_cert_key         = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] driver_data_namespace          = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] driver_ssl_cert_path           = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] driver_ssl_cert_verify         = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] driver_use_ssl                 = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] enable_force_upload            = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] enable_new_services            = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] enable_unsupported_driver      = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] enforce_multipath_for_image_xfer = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] filter_function                = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance_api_insecure            = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance_api_servers             = ['http://192.168.122.158/image'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance_api_ssl_compression     = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance_ca_certificates_file    = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75578]: INFO cinder.volume.manager [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance_certfile                = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance_keyfile                 = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance_num_retries             = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance_request_timeout         = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] goodness_function              = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] graceful_shutdown_timeout      = 5 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] group_api_class                = cinder.group.api.API {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] host                           = devstack {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] image_compress_on_upload       = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] image_conversion_address_space_limit = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] image_conversion_cpu_limit     = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] image_conversion_disable       = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] image_upload_use_cinder_backend = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] image_upload_use_internal_tenant = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] image_volume_cache_enabled     = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] image_volume_cache_max_count   = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] image_volume_cache_max_size_gb = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] init_host_max_objects_retrieval = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] iscsi_target_flags             =  {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] iscsi_write_cache              = on {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] iser_helper                    = tgtadm {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] iser_ip_address                = 192.168.122.158 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] iser_port                      = 3260 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] log_color                      = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] log_config_append              = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] log_dir                        = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] log_file                       = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] log_options                    = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] log_rotate_interval            = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] log_rotate_interval_type       = days {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] log_rotation_type              = none {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] max_age                        = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] max_logfile_count              = 30 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] max_logfile_size_mb            = 200 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] max_over_subscription_ratio    = 20.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] message_reap_interval          = 86400 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] message_ttl                    = 2592000 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:02 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] migration_create_volume_timeout_secs = 300 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] monkey_patch                   = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] monkey_patch_modules           = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] my_ip                          = 192.168.122.158 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] no_snapshot_gb_quota           = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] num_iser_scan_tries            = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] num_shell_tries                = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] num_volume_device_scan_tries   = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] nvmeof_conn_info_version       = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] nvmet_ns_id                    = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] nvmet_port_id                  = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] osapi_max_limit                = 1000 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] osapi_volume_ext_list          = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] osapi_volume_listen_port       = 8776 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] osapi_volume_use_ssl           = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] osapi_volume_workers           = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] per_volume_size_limit          = -1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] periodic_fuzzy_delay           = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] periodic_interval              = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] public_endpoint                = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] publish_errors                 = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] quota_backup_gigabytes         = 1000 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] quota_backups                  = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] quota_gigabytes                = 1000 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] quota_groups                   = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] quota_snapshots                = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] quota_volumes                  = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] rate_limit_burst               = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] rate_limit_except_level        = CRITICAL {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] rate_limit_interval            = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] reinit_driver_count            = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] replication_device             = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] report_discard_supported       = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] report_interval                = 120 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] reservation_clean_interval     = 86400 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] reservation_expire             = 86400 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] reserved_image_namespaces      = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] reserved_percentage            = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] rpc_response_timeout           = 120 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] run_external_periodic_tasks    = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] scst_target_driver             = iscsi {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] scst_target_iqn_name           = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] service_down_time              = 720 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] shell_completion               = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] snapshot_name_template         = snapshot-%s {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] snapshot_same_host             = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] split_loggers                  = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] state_path                     = /opt/stack/data/cinder {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] storage_availability_zone      = nova {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] storage_protocol               = iSCSI {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] syslog_log_facility            = LOG_USER {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] target_helper                  = lioadm {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] target_ip_address              = 192.168.122.158 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] target_port                    = 3260 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] target_protocol                = iscsi {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] target_secondary_ip_addresses  = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] trace_flags                    = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] transport_url                  = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] until_refresh                  = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] use_chap_auth                  = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] use_default_quota_class        = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] use_journal                    = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] use_json                       = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] use_multipath_for_image_xfer   = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] use_stderr                     = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] use_syslog                     = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] verify_glance_signatures       = enabled {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] volume_api_class               = cinder.volume.api.API {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] volume_backend_name            = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] volume_clear                   = zero {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] volume_clear_ionice            = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] volume_clear_size              = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] volume_copy_bps_limit          = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] volume_dd_blocksize            = 1M {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] volume_name_template           = volume-%s {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] volume_service_inithost_offload = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] volume_usage_audit_period      = month {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] zoning_mode                    = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_concurrency.disable_process_locking = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.auth_section = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.auth_type   = password {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.auth_version = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.cache       = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.certfile    = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.include_service_catalog = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.insecure    = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.interface   = public {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.keyfile     = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcache_password =  {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack sudo[75583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack sudo[75583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcache_username =  {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.region_name = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.service_type = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.158/identity {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.backend                  = dogpile.cache.null {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.backend_argument         = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.backend_expiration_time  = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.config_prefix            = cache.oslo {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.debug_cache_backend      = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.enable_retry_client      = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.enable_socket_keepalive  = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.enabled                  = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.expiration_time          = 600 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.hashclient_retry_attempts = 2 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.memcache_dead_retry      = 300 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.memcache_sasl_enabled    = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.password                 = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.proxies                  = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.redis_db                 = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.redis_server             = localhost:6379 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.retry_attempts           = 2 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.retry_delay              = 0.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.socket_keepalive_count   = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.socket_keepalive_idle    = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.socket_keepalive_interval = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.socket_timeout           = 1.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.tls_allowed_ciphers      = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.tls_cafile               = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.tls_certfile             = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.tls_enabled              = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.tls_keyfile              = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cache.username                 = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] coordination.backend_url       = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.asyncio_connection    = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.asyncio_slave_connection = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.backend               = sqlalchemy {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.connection            = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.connection_debug      = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.connection_parameters =  {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.connection_recycle_time = 3600 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.connection_trace      = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.db_inc_retry_interval = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.db_max_retries        = 20 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.db_max_retry_interval = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.db_retry_interval     = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.max_overflow          = 50 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.max_pool_size         = 5 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.max_retries           = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.mysql_wsrep_sync_wait = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.pool_timeout          = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.retry_interval        = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.slave_connection      = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.sqlite_synchronous    = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.synchronous_reader    = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] database.use_db_reconnect      = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] profiler.connection_string     = messaging:// {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] profiler.enabled               = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] profiler.es_doc_type           = notification {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] profiler.es_scroll_size        = 10000 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] profiler.es_scroll_time        = 2m {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] profiler.filter_error_trace    = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] profiler.hmac_keys             = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] profiler.sentinel_service_name = mymaster {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] profiler.socket_timeout        = 0.1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] profiler.trace_requests        = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] profiler.trace_sqlalchemy      = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] profiler_jaeger.process_tags   = {} {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] profiler_jaeger.service_name_prefix = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] profiler_otlp.service_name_prefix = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_policy.enforce_new_defaults = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_policy.enforce_scope      = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_policy.policy_default_rule = default {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] privsep_osbrick.group          = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] privsep_osbrick.helper_command = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] privsep_osbrick.user           = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cinder_sys_admin.group         = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cinder_sys_admin.helper_command = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] cinder_sys_admin.user          = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] service_user.auth_section      = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] service_user.auth_type         = password {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] service_user.cafile            = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] service_user.certfile          = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] service_user.collect_timing    = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] service_user.insecure          = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] service_user.keyfile           = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] service_user.send_service_user_token = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] service_user.split_loggers     = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] service_user.timeout           = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance.auth_section            = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance.auth_type               = password {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance.certfile                = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance.collect_timing          = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance.insecure                = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance.keyfile                 = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance.region_name             = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance.split_loggers           = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] glance.timeout                 = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.backend_availability_zone = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.chap_password = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.chap_username =  {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.disk_geometry = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.driver_client_cert = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.driver_client_cert_key = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.driver_data_namespace = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.driver_use_ssl = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.extra_capabilities = {} {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.filter_function = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.goodness_function = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.iscsi_target_flags =  {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.iscsi_write_cache = on {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.iser_ip_address = 192.168.122.158 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.iser_port     = 3260 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.lvm_share_target = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.lvm_type      = auto {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.num_shell_tries = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.replication_device = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.report_discard_supported = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.reserved_percentage = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.target_helper = tgtadm {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.target_ip_address = 192.168.122.158 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.target_port   = 3260 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.target_protocol = iscsi {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.trace_flags   = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.unique_fqdn_network = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.use_chap_auth = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.volume_backend_name = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.volume_clear  = zero {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.volume_clear_ionice = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.volume_clear_size = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_reports.file_event_handler = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_reports.log_dir           = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.backend_host       = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.chap_password      = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.chap_username      = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.disk_geometry      = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.driver_client_cert = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.extra_capabilities = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.filter_function    = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.goodness_function  = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.iser_helper        = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.iser_port          = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.lvm_type           = auto {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.replication_device = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.report_discard_supported = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.reserved_percentage = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.scst_target_driver = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.storage_protocol   = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.target_ip_address  = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.target_port        = 3260 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.trace_flags        = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.volume_clear       = zero {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] lvmdriver-1.volumes_dir        = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_notifications.driver = [] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_notifications.retry = -1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] key_manager.fixed_key          = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.barbican_api_version  = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.barbican_endpoint     = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.barbican_endpoint_type = public {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.barbican_region_name  = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.cafile                = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.certfile              = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.collect_timing        = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.insecure              = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.keyfile               = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.number_of_retries     = 60 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.retry_delay           = 1 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.send_service_user_token = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.split_loggers         = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.timeout               = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.verify_ssl            = True {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican.verify_ssl_path       = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican_service_user.auth_section = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican_service_user.auth_type = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican_service_user.cafile   = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican_service_user.certfile = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican_service_user.collect_timing = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican_service_user.insecure = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican_service_user.keyfile  = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican_service_user.split_loggers = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] barbican_service_user.timeout  = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] vault.approle_role_id          = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] vault.approle_secret_id        = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] vault.kv_mountpoint            = secret {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] vault.kv_path                  = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] vault.kv_version               = 2 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] vault.namespace                = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] vault.root_token_id            = **** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] vault.ssl_ca_crt_file          = None {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] vault.timeout                  = 60.0 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] vault.use_ssl                  = False {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:43:03 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] ******************************************************************************** {{(pid=75410) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 03 23:43:03 devstack sudo[75583]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:03 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.709s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:03 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:03 devstack sudo[75629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:43:03 devstack sudo[75629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:04 devstack sudo[75629]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:04 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.643s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:04 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:43:04 devstack cinder-volume[75578]: INFO cinder.brick.local_dev.lvm [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 03 23:43:04 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:04 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:04 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:04 devstack sudo[75893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:43:04 devstack sudo[75893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:05 devstack sudo[75893]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:05 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:05 devstack cinder-volume[75578]: DEBUG cinder.brick.local_dev.lvm [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75578) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jul 03 23:43:05 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:05 devstack sudo[76070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:43:05 devstack sudo[76070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:06 devstack sudo[76070]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:06 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.577s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:06 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:06 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:06 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:06 devstack sudo[76333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:43:06 devstack sudo[76333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:07 devstack sudo[76333]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:07 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.706s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:07 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:07 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:07 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:07 devstack sudo[76362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 03 23:43:07 devstack sudo[76362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:08 devstack sudo[76362]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:08 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.699s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:08 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:08 devstack sudo[76366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:43:08 devstack sudo[76366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:09 devstack sudo[76366]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:09 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.903s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:09 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:09 devstack sudo[76369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:43:09 devstack sudo[76369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:09 devstack sudo[76369]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:09 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.741s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:09 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:09 devstack sudo[76381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:43:09 devstack sudo[76381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:10 devstack sudo[76381]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:10 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.900s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:10 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:10 devstack sudo[76388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:43:10 devstack sudo[76388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:11 devstack sudo[76388]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:11 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.729s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:11 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:11 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:11 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:11 devstack sudo[76396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:43:11 devstack sudo[76396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:12 devstack sudo[76396]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:12 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:12 devstack cinder-volume[75578]: INFO cinder.volume.drivers.lvm [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 03 23:43:12 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:12 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:12 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:12 devstack sudo[76405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:43:12 devstack sudo[76405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:12 devstack cinder-volume[75410]: DEBUG dbcounter [-] [75410] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75410) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:43:13 devstack sudo[76405]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:13 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.951s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:13 devstack cinder-volume[75578]: DEBUG cinder.volume.drivers.lvm [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Updating volume stats {{(pid=75578) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:232}}
Jul 03 23:43:13 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:13 devstack sudo[76524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:43:13 devstack sudo[76524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:13 devstack sudo[76524]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:13 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:13 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:13 devstack sudo[76665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:43:13 devstack sudo[76665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:14 devstack sudo[76665]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:14 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:14 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:14 devstack sudo[76668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:43:14 devstack sudo[76668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:15 devstack sudo[76668]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:15 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.622s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:15 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:15 devstack sudo[76671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:43:15 devstack sudo[76671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:15 devstack sudo[76671]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:15 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:15 devstack cinder-volume[75578]: INFO cinder.volume.driver [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Driver hasn't implemented _init_vendor_properties()
Jul 03 23:43:15 devstack cinder-volume[75578]: DEBUG cinder.volume.driver [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75578) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 03 23:43:15 devstack cinder-volume[75578]: DEBUG oslo_db.sqlalchemy.engines [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75578) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:43:15 devstack cinder-volume[75578]: DEBUG dbcounter [-] [75578] Writer thread running {{(pid=75578) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 23:43:15 devstack cinder-volume[75578]: DEBUG cinder.db.api [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Building query based on filter {{(pid=75578) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 03 23:43:15 devstack cinder-volume[75578]: DEBUG cinder.image.image_utils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75578) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 03 23:43:15 devstack cinder-volume[75578]: INFO cinder.keymgr.migration [None req-e0aed741-a205-47f4-beea-e46779d58915 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 03 23:43:15 devstack cinder-volume[75578]: DEBUG cinder.volume.drivers.lvm [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Updating volume stats {{(pid=75578) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:232}}
Jul 03 23:43:15 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:15 devstack sudo[76675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:43:15 devstack sudo[76675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:16 devstack sudo[76675]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:16 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:16 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:16 devstack sudo[76680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:43:16 devstack sudo[76680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:17 devstack sudo[76680]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:17 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:17 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:17 devstack sudo[76685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:43:17 devstack sudo[76685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:17 devstack sudo[76685]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:17 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.690s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:17 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:17 devstack sudo[76689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:43:17 devstack sudo[76689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:18 devstack sudo[76689]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:18 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:18 devstack cinder-volume[75578]: DEBUG cinder.manager [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Notifying Schedulers of capabilities ... {{(pid=75578) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:43:18 devstack cinder-volume[75578]: INFO cinder.volume.manager [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Driver initialization completed successfully.
Jul 03 23:43:18 devstack cinder-volume[75578]: INFO cinder.manager [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Initiating service 2 cleanup
Jul 03 23:43:18 devstack cinder-volume[75578]: INFO cinder.manager [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Service 2 cleanup completed.
Jul 03 23:43:18 devstack cinder-volume[75578]: DEBUG cinder.service [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Creating RPC server for service cinder-volume {{(pid=75578) start /opt/stack/cinder/cinder/service.py:231}}
Jul 03 23:43:18 devstack cinder-volume[75578]: DEBUG cinder.service [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75578) start /opt/stack/cinder/cinder/service.py:237}}
Jul 03 23:43:18 devstack cinder-volume[75578]: INFO cinder.volume.manager [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 03 23:43:18 devstack cinder-volume[75578]: DEBUG cinder.volume.drivers.lvm [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Updating volume stats {{(pid=75578) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:232}}
Jul 03 23:43:18 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:18 devstack sudo[76693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:43:18 devstack sudo[76693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:19 devstack sudo[76693]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:19 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:19 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:19 devstack sudo[76696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:43:19 devstack sudo[76696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:19 devstack sudo[76696]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:19 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.701s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:19 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:19 devstack sudo[76751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:43:19 devstack sudo[76751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:20 devstack sudo[76751]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:20 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.633s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:20 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:43:20 devstack sudo[76759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:43:20 devstack sudo[76759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:43:21 devstack sudo[76759]: pam_unix(sudo:session): session closed for user root
Jul 03 23:43:21 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:43:21 devstack cinder-volume[75578]: INFO cinder.volume.manager [None req-3e8fa67f-131c-409e-80aa-132bfa1a7263 None None] Driver post RPC initialization completed successfully.
Jul 03 23:43:24 devstack cinder-volume[75578]: DEBUG oslo_service.periodic_task [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running periodic task VolumeManager._thread_info {{(pid=75578) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:43:24 devstack cinder-volume[75578]: DEBUG cinder.volume.manager [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] thread count: 6 {{(pid=75578) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:43:24 devstack cinder-volume[75578]: DEBUG cinder.volume.manager [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] thread info: [<_MainThread(MainThread, started 135909849641088)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135909739717184)>, <Thread(Thread-3 (stat_writer), started daemon 135909737979840)>, <Thread(Rabbit-heartbeat, started daemon 135909737928512)>, <Thread(Thread-5 (_runner), started daemon 135909735672640)>, <Thread(Thread-7 (_runner), started daemon 135909735740160)>] {{(pid=75578) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:43:31 devstack cinder-volume[75578]: DEBUG dbcounter [-] [75578] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75578) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:43:31 devstack cinder-volume[75578]: DEBUG dbcounter [-] [75578] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75578) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:44:24 devstack cinder-volume[75578]: DEBUG oslo_service.periodic_task [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75578) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:44:24 devstack cinder-volume[75578]: DEBUG cinder.volume.drivers.lvm [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Updating volume stats {{(pid=75578) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:232}}
Jul 03 23:44:24 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:44:24 devstack sudo[78511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:44:24 devstack sudo[78511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:44:24 devstack sudo[78511]: pam_unix(sudo:session): session closed for user root
Jul 03 23:44:24 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:44:24 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:44:24 devstack sudo[78514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:44:24 devstack sudo[78514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:44:25 devstack sudo[78514]: pam_unix(sudo:session): session closed for user root
Jul 03 23:44:25 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:44:25 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:44:25 devstack sudo[78517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:44:25 devstack sudo[78517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:44:26 devstack sudo[78517]: pam_unix(sudo:session): session closed for user root
Jul 03 23:44:26 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.662s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:44:26 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:44:26 devstack sudo[78520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:44:26 devstack sudo[78520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:44:26 devstack sudo[78520]: pam_unix(sudo:session): session closed for user root
Jul 03 23:44:26 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.688s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:44:26 devstack cinder-volume[75578]: DEBUG cinder.manager [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Notifying Schedulers of capabilities ... {{(pid=75578) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:44:26 devstack cinder-volume[75578]: DEBUG oslo_service.periodic_task [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running periodic task VolumeManager._thread_info {{(pid=75578) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:44:26 devstack cinder-volume[75578]: DEBUG cinder.volume.manager [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] thread count: 6 {{(pid=75578) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:44:26 devstack cinder-volume[75578]: DEBUG cinder.volume.manager [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] thread info: [<_MainThread(MainThread, started 135909849641088)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135909739717184)>, <Thread(Thread-3 (stat_writer), started daemon 135909737979840)>, <Thread(Rabbit-heartbeat, started daemon 135909737928512)>, <Thread(Thread-5 (_runner), started daemon 135909735672640)>, <Thread(Thread-7 (_runner), started daemon 135909735740160)>] {{(pid=75578) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:45:24 devstack cinder-volume[75578]: DEBUG oslo_service.periodic_task [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75578) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:45:24 devstack cinder-volume[75578]: DEBUG cinder.volume.drivers.lvm [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Updating volume stats {{(pid=75578) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:232}}
Jul 03 23:45:24 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:45:24 devstack sudo[81881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:45:24 devstack sudo[81881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:45:24 devstack sudo[81881]: pam_unix(sudo:session): session closed for user root
Jul 03 23:45:24 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:45:24 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:45:24 devstack sudo[81885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:45:24 devstack sudo[81885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:45:25 devstack sudo[81885]: pam_unix(sudo:session): session closed for user root
Jul 03 23:45:25 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:45:25 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:45:25 devstack sudo[81893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:45:25 devstack sudo[81893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:45:26 devstack sudo[81893]: pam_unix(sudo:session): session closed for user root
Jul 03 23:45:26 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.616s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:45:26 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:45:26 devstack sudo[81912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:45:26 devstack sudo[81912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:45:26 devstack sudo[81912]: pam_unix(sudo:session): session closed for user root
Jul 03 23:45:26 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:45:26 devstack cinder-volume[75578]: DEBUG cinder.manager [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Notifying Schedulers of capabilities ... {{(pid=75578) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:45:26 devstack cinder-volume[75578]: DEBUG oslo_service.periodic_task [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running periodic task VolumeManager._thread_info {{(pid=75578) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:45:26 devstack cinder-volume[75578]: DEBUG cinder.volume.manager [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] thread count: 6 {{(pid=75578) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:45:26 devstack cinder-volume[75578]: DEBUG cinder.volume.manager [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] thread info: [<_MainThread(MainThread, started 135909849641088)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135909739717184)>, <Thread(Thread-3 (stat_writer), started daemon 135909737979840)>, <Thread(Rabbit-heartbeat, started daemon 135909737928512)>, <Thread(Thread-5 (_runner), started daemon 135909735672640)>, <Thread(Thread-7 (_runner), started daemon 135909735740160)>] {{(pid=75578) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:45:31 devstack cinder-volume[75578]: DEBUG dbcounter [-] [75578] Writing DB stats cinder:SELECT=1 {{(pid=75578) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:45:31 devstack cinder-volume[75578]: DEBUG dbcounter [-] [75578] Writing DB stats cinder:UPDATE=1 {{(pid=75578) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:46:24 devstack cinder-volume[75578]: DEBUG oslo_service.periodic_task [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75578) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:46:24 devstack cinder-volume[75578]: DEBUG cinder.volume.drivers.lvm [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Updating volume stats {{(pid=75578) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:232}}
Jul 03 23:46:24 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:46:24 devstack sudo[83927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:46:24 devstack sudo[83927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:46:24 devstack sudo[83927]: pam_unix(sudo:session): session closed for user root
Jul 03 23:46:24 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:46:24 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:46:24 devstack sudo[83933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:46:24 devstack sudo[83933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:46:25 devstack sudo[83933]: pam_unix(sudo:session): session closed for user root
Jul 03 23:46:25 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:46:25 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:46:25 devstack sudo[83939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:46:25 devstack sudo[83939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:46:26 devstack sudo[83939]: pam_unix(sudo:session): session closed for user root
Jul 03 23:46:26 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.625s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:46:26 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:46:26 devstack sudo[83953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:46:26 devstack sudo[83953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:46:26 devstack sudo[83953]: pam_unix(sudo:session): session closed for user root
Jul 03 23:46:26 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:46:26 devstack cinder-volume[75578]: DEBUG cinder.manager [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Notifying Schedulers of capabilities ... {{(pid=75578) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:46:26 devstack cinder-volume[75578]: DEBUG oslo_service.periodic_task [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running periodic task VolumeManager._thread_info {{(pid=75578) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:46:26 devstack cinder-volume[75578]: DEBUG cinder.volume.manager [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] thread count: 6 {{(pid=75578) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:46:26 devstack cinder-volume[75578]: DEBUG cinder.volume.manager [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] thread info: [<_MainThread(MainThread, started 135909849641088)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135909739717184)>, <Thread(Thread-3 (stat_writer), started daemon 135909737979840)>, <Thread(Rabbit-heartbeat, started daemon 135909737928512)>, <Thread(Thread-5 (_runner), started daemon 135909735672640)>, <Thread(Thread-7 (_runner), started daemon 135909735740160)>] {{(pid=75578) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:47:24 devstack cinder-volume[75578]: DEBUG oslo_service.periodic_task [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75578) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:47:24 devstack cinder-volume[75578]: DEBUG cinder.volume.drivers.lvm [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Updating volume stats {{(pid=75578) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:232}}
Jul 03 23:47:24 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:24 devstack sudo[85220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 03 23:47:24 devstack sudo[85220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:24 devstack sudo[85220]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:24 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:24 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:24 devstack sudo[85234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:47:24 devstack sudo[85234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:25 devstack sudo[85234]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:25 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:25 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:25 devstack sudo[85238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 03 23:47:25 devstack sudo[85238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:26 devstack sudo[85238]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:26 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.684s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:26 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:26 devstack sudo[85252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 03 23:47:26 devstack sudo[85252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:26 devstack sudo[85252]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:26 devstack cinder-volume[75578]: DEBUG oslo_concurrency.processutils [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.700s {{(pid=75578) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:26 devstack cinder-volume[75578]: DEBUG cinder.manager [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Notifying Schedulers of capabilities ... {{(pid=75578) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:47:27 devstack cinder-volume[75578]: DEBUG oslo_service.periodic_task [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] Running periodic task VolumeManager._thread_info {{(pid=75578) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:47:27 devstack cinder-volume[75578]: DEBUG cinder.volume.manager [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] thread count: 6 {{(pid=75578) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:47:27 devstack cinder-volume[75578]: DEBUG cinder.volume.manager [None req-9a2731d7-b111-45d6-9402-5225b81a8b3b None None] thread info: [<_MainThread(MainThread, started 135909849641088)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135909739717184)>, <Thread(Thread-3 (stat_writer), started daemon 135909737979840)>, <Thread(Rabbit-heartbeat, started daemon 135909737928512)>, <Thread(Thread-5 (_runner), started daemon 135909735672640)>, <Thread(Thread-7 (_runner), started daemon 135909735740160)>] {{(pid=75578) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:47:31 devstack cinder-volume[75578]: DEBUG dbcounter [-] [75578] Writing DB stats cinder:SELECT=1 {{(pid=75578) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:47:31 devstack cinder-volume[75578]: DEBUG dbcounter [-] [75578] Writing DB stats cinder:UPDATE=1 {{(pid=75578) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:47:39 devstack cinder-volume[75410]: INFO oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Caught SIGTERM, stopping children
Jul 03 23:47:39 devstack cinder-volume[75410]: DEBUG oslo_concurrency.lockutils [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Acquiring lock "singleton_lock" {{(pid=75410) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 23:47:39 devstack cinder-volume[75410]: DEBUG oslo_concurrency.lockutils [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Acquired lock "singleton_lock" {{(pid=75410) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 23:47:39 devstack cinder-volume[75410]: DEBUG oslo_concurrency.lockutils [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Releasing lock "singleton_lock" {{(pid=75410) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 23:47:39 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Stop services. {{(pid=75410) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 03 23:47:39 devstack cinder-volume[75410]: DEBUG oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Killing children. {{(pid=75410) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 03 23:47:39 devstack cinder-volume[75410]: INFO oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Waiting on 1 children to exit
Jul 03 23:47:43 devstack cinder-volume[75578]: DEBUG oslo_concurrency.lockutils [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Acquiring lock "singleton_lock" {{(pid=75578) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 23:47:43 devstack cinder-volume[75578]: DEBUG oslo_concurrency.lockutils [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Acquired lock "singleton_lock" {{(pid=75578) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 23:47:43 devstack cinder-volume[75578]: DEBUG oslo_concurrency.lockutils [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Releasing lock "singleton_lock" {{(pid=75578) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 23:47:43 devstack cinder-volume[75578]: WARNING amqp [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 23:47:43 devstack cinder-volume[75578]: WARNING amqp [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 23:47:43 devstack cinder-volume[75410]: INFO oslo_service.backend._eventlet.service [None req-88d6804d-78c6-407b-92df-9fae6dc985e2 None None] Child 75578 exited with status 0
Jul 03 23:47:44 devstack cinder-volume[85702]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 03 23:47:44 devstack cinder-volume[85702]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 23:47:44 devstack cinder-volume[85702]: we strongly recommend against using it for new projects.
Jul 03 23:47:44 devstack cinder-volume[85702]: If you are already using Eventlet, we recommend migrating to a different
Jul 03 23:47:44 devstack cinder-volume[85702]: framework.  For more detail see
Jul 03 23:47:44 devstack cinder-volume[85702]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 23:47:44 devstack cinder-volume[85702]:   import eventlet  # noqa
Jul 03 23:47:46 devstack cinder-volume[85702]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85702) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 23:47:46 devstack cinder-volume[85702]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85702) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 23:47:46 devstack cinder-volume[85702]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85702) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 23:47:46 devstack cinder-volume[85702]: INFO dbcounter [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Registered counter for database cinder
Jul 03 23:47:46 devstack cinder-volume[85702]: DEBUG oslo_db.sqlalchemy.engines [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85702) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG dbcounter [-] [85702] Writer thread running {{(pid=85702) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 23:47:47 devstack cinder-volume[85702]: INFO cinder.rpc [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 03 23:47:47 devstack cinder-volume[85702]: INFO cinder.rpc [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_db.sqlalchemy.engines [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85702) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:47:47 devstack cinder-volume[85702]: INFO cinder.volume.manager [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Determined volume DB was empty at startup.
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG cinder.volume.manager [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85702) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 03 23:47:47 devstack cinder-volume[85702]: INFO cinder.volume.manager [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 03 23:47:47 devstack cinder-volume[85702]: WARNING stevedore.named [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 23:47:47 devstack cinder-volume[85702]: WARNING castellan.key_manager [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 23:47:47 devstack cinder-volume[85702]: WARNING cinder.keymgr.conf_key_mgr [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 23:47:47 devstack cinder-volume[85702]: INFO cinder.volume.manager [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_db.sqlalchemy.engines [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85702) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:47:47 devstack cinder-volume[85702]: INFO oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Starting 1 workers
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Started child 85918 {{(pid=85702) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Full set of CONF: {{(pid=85702) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] ******************************************************************************** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Configuration options gathered from: {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 03 23:47:47 devstack cinder-volume[85918]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] ================================================================================ {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] allow_availability_zone_fallback = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] allow_compression_on_image_upload = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] allowed_direct_url_schemes     = [] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] api_rate_limit                 = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] auth_strategy                  = keystone {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_availability_zone      = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_host                   = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_name                   = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_stats_polling_interval = 60 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backup_api_class               = cinder.backup.api.API {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backup_name_template           = backup-%s {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backup_use_same_host           = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backup_use_temp_snapshot       = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] chap_password                  = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] chap_username                  =  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cinder_internal_tenant_project_id = 157d44153e3443d0a283f0f3ed2fa3bd {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cinder_internal_tenant_user_id = f430159010d04fed8937ac8583e2634b {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cluster                        = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] compression_format             = gzip {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] compute_api_class              = cinder.compute.nova.API {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] config_dir                     = [] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] config_source                  = [] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] control_exchange               = openstack {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] debug                          = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] default_availability_zone      = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] default_group_type             = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] default_volume_type            = QuobyteHD {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] disk_geometry                  = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] driver_client_cert             = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] driver_client_cert_key         = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] driver_data_namespace          = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] driver_ssl_cert_path           = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] driver_ssl_cert_verify         = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] driver_use_ssl                 = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] enable_new_services            = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] enable_unsupported_driver      = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] enabled_backends               = ['QuobyteHD'] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] enforce_multipath_for_image_xfer = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] filter_function                = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance_api_insecure            = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance_api_servers             = ['http://192.168.122.158/image'] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance_api_ssl_compression     = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance_ca_certificates_file    = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance_catalog_info            = image:glance:publicURL {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance_certfile                = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance_keyfile                 = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance_num_retries             = 3 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance_request_timeout         = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] goodness_function              = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] graceful_shutdown_timeout      = 5 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] group_api_class                = cinder.group.api.API {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] host                           = devstack {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] image_compress_on_upload       = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] image_conversion_address_space_limit = 1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] image_conversion_cpu_limit     = 60 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] image_conversion_disable       = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] image_upload_use_cinder_backend = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] image_upload_use_internal_tenant = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] image_volume_cache_enabled     = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] image_volume_cache_max_count   = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] image_volume_cache_max_size_gb = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] init_host_max_objects_retrieval = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] instance_format                = [instance: %(uuid)s]  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] iscsi_target_flags             =  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] iscsi_write_cache              = on {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] iser_helper                    = tgtadm {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] iser_ip_address                = 192.168.122.158 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] iser_port                      = 3260 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] log_color                      = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] log_config_append              = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] log_dir                        = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85918]: INFO cinder.volume.manager [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 03 23:47:47 devstack cinder-volume[85918]: DEBUG cinder.volume.drivers.remotefs [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85918) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] log_file                       = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] log_options                    = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] log_rotate_interval            = 1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] log_rotate_interval_type       = days {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] log_rotation_type              = none {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] max_age                        = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] max_logfile_count              = 30 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] max_logfile_size_mb            = 200 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] max_over_subscription_ratio    = 20.0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] message_reap_interval          = 86400 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] message_ttl                    = 2592000 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] migration_create_volume_timeout_secs = 300 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] monkey_patch                   = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] monkey_patch_modules           = [] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] my_ip                          = 192.168.122.158 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] no_snapshot_gb_quota           = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] num_iser_scan_tries            = 3 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] num_shell_tries                = 3 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] num_volume_device_scan_tries   = 3 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] nvmeof_conn_info_version       = 1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] nvmet_ns_id                    = 10 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] nvmet_port_id                  = 1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] osapi_max_limit                = 1000 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] osapi_volume_ext_list          = [] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] osapi_volume_listen_port       = 8776 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] osapi_volume_use_ssl           = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] osapi_volume_workers           = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] per_volume_size_limit          = -1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] periodic_fuzzy_delay           = 60 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] periodic_interval              = 60 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] public_endpoint                = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] publish_errors                 = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] quota_backup_gigabytes         = 1000 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] quota_backups                  = 10 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] quota_gigabytes                = 1000 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] quota_groups                   = 10 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] quota_snapshots                = 10 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] quota_volumes                  = 10 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] rate_limit_burst               = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] rate_limit_except_level        = CRITICAL {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] rate_limit_interval            = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] reinit_driver_count            = 3 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] replication_device             = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] report_discard_supported       = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] report_interval                = 120 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] reservation_clean_interval     = 86400 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] reservation_expire             = 86400 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] reserved_image_namespaces      = [] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] reserved_percentage            = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] rpc_response_timeout           = 120 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] run_external_periodic_tasks    = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] scst_target_driver             = iscsi {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] scst_target_iqn_name           = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] service_down_time              = 720 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] shell_completion               = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] snapshot_name_template         = snapshot-%s {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] split_loggers                  = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] state_path                     = /opt/stack/data/cinder {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] storage_availability_zone      = nova {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] storage_protocol               = iSCSI {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] syslog_log_facility            = LOG_USER {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] target_helper                  = lioadm {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] target_ip_address              = 192.168.122.158 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] target_port                    = 3260 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] target_protocol                = iscsi {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] target_secondary_ip_addresses  = [] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] trace_flags                    = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] transport_url                  = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] until_refresh                  = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] use_chap_auth                  = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] use_default_quota_class        = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] use_journal                    = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] use_json                       = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] use_multipath_for_image_xfer   = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] use_stderr                     = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] use_syslog                     = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] verify_glance_signatures       = enabled {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] volume_api_class               = cinder.volume.api.API {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] volume_backend_name            = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] volume_clear                   = zero {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] volume_clear_ionice            = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] volume_clear_size              = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] volume_copy_bps_limit          = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] volume_dd_blocksize            = 1M {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] volume_name_template           = volume-%s {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] volume_service_inithost_offload = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] volume_usage_audit_period      = month {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] zoning_mode                    = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_concurrency.disable_process_locking = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.auth_section = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.auth_type   = password {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.auth_version = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.cache       = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.certfile    = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.delay_auth_decision = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.http_connect_timeout = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.include_service_catalog = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.insecure    = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.interface   = public {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.keyfile     = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcache_password =  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcache_username =  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.region_name = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.service_token_roles_required = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.service_type = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.token_cache_time = 300 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.158/identity {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.backend                  = dogpile.cache.null {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.backend_argument         = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.backend_expiration_time  = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.config_prefix            = cache.oslo {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.debug_cache_backend      = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.enable_retry_client      = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.enable_socket_keepalive  = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.enabled                  = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.expiration_time          = 600 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.hashclient_retry_attempts = 2 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.memcache_dead_retry      = 300 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.memcache_pool_maxsize    = 10 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.memcache_sasl_enabled    = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.password                 = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.proxies                  = [] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.redis_db                 = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.redis_sentinel_service_name = mymaster {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.redis_server             = localhost:6379 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.retry_attempts           = 2 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.retry_delay              = 0.0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.socket_keepalive_count   = 1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.socket_keepalive_idle    = 1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85918]: DEBUG cinder.volume.drivers.quobyte [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85918) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 03 23:47:47 devstack cinder-volume[85918]: WARNING cinder.volume.drivers.quobyte [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 03 23:47:47 devstack cinder-volume[85918]: WARNING cinder.volume.drivers.quobyte [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 03 23:47:47 devstack cinder-volume[85918]: DEBUG oslo_concurrency.processutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Running cmd (subprocess): mount.quobyte {{(pid=85918) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.socket_keepalive_interval = 1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.socket_timeout           = 1.0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.tls_allowed_ciphers      = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.tls_cafile               = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.tls_certfile             = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.tls_enabled              = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.tls_keyfile              = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cache.username                 = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] coordination.backend_url       = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.asyncio_connection    = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.asyncio_slave_connection = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.backend               = sqlalchemy {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.connection            = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.connection_debug      = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.connection_parameters =  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.connection_recycle_time = 3600 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.connection_trace      = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.db_inc_retry_interval = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.db_max_retries        = 20 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.db_max_retry_interval = 10 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.db_retry_interval     = 1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.max_overflow          = 50 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.max_pool_size         = 5 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.max_retries           = 10 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.mysql_wsrep_sync_wait = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.pool_timeout          = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.retry_interval        = 10 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.slave_connection      = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.sqlite_synchronous    = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.synchronous_reader    = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] database.use_db_reconnect      = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] profiler.connection_string     = messaging:// {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] profiler.enabled               = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] profiler.es_doc_type           = notification {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] profiler.es_scroll_size        = 10000 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] profiler.es_scroll_time        = 2m {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] profiler.filter_error_trace    = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] profiler.hmac_keys             = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] profiler.sentinel_service_name = mymaster {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] profiler.socket_timeout        = 0.1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] profiler.trace_requests        = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] profiler.trace_sqlalchemy      = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] profiler_jaeger.process_tags   = {} {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] profiler_jaeger.service_name_prefix = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] profiler_otlp.service_name_prefix = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_policy.enforce_new_defaults = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_policy.enforce_scope      = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_policy.policy_default_rule = default {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_policy.policy_file        = policy.yaml {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] privsep_osbrick.group          = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] privsep_osbrick.helper_command = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] privsep_osbrick.user           = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cinder_sys_admin.group         = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cinder_sys_admin.helper_command = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] cinder_sys_admin.user          = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] service_user.auth_section      = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] service_user.auth_type         = password {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] service_user.cafile            = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] service_user.certfile          = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] service_user.collect_timing    = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] service_user.insecure          = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] service_user.keyfile           = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] service_user.send_service_user_token = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] service_user.split_loggers     = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] service_user.timeout           = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance.auth_section            = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance.auth_type               = password {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance.certfile                = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance.collect_timing          = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance.insecure                = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance.keyfile                 = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance.region_name             = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance.split_loggers           = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] glance.timeout                 = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.backend_availability_zone = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.chap_password = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.chap_username =  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.disk_geometry = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.driver_client_cert = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.driver_client_cert_key = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.driver_data_namespace = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.driver_use_ssl = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.enable_unsupported_driver = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.extra_capabilities = {} {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.filter_function = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.goodness_function = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.iscsi_target_flags =  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.iscsi_write_cache = on {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.iser_helper   = tgtadm {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.iser_ip_address = 192.168.122.158 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.iser_port     = 3260 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.nas_host      =  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.nas_login     = admin {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.nas_mount_options = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.nas_password  = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.nas_private_key =  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.nas_share_path =  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.num_shell_tries = 3 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.nvmet_port_id = 1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.quobyte_client_cfg = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.quobyte_volume_url = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.replication_device = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.report_discard_supported = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.reserved_percentage = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.scst_target_driver = iscsi {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.scst_target_iqn_name = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.storage_protocol = iSCSI {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.target_helper = tgtadm {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.target_ip_address = 192.168.122.158 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.target_port   = 3260 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.target_protocol = iscsi {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.trace_flags   = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.unique_fqdn_network = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.use_chap_auth = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.volume_backend_name = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.volume_clear  = zero {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.volume_clear_ionice = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.volume_clear_size = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_reports.file_event_handler = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_reports.log_dir           = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.backend_availability_zone = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.backend_host         = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.chap_password        = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.chap_username        = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.chiscsi_conf         = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.disk_geometry        = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.driver_client_cert   = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.driver_client_cert_key = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.driver_data_namespace = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.driver_use_ssl       = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.extra_capabilities   = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.filter_function      = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.goodness_function    = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.iser_helper          = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.iser_ip_address      = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.iser_port            = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.iser_target_prefix   = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.nas_host             = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.nas_login            = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.nas_mount_options    = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.nas_password         = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.nas_private_key      = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.nas_share_path       = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.nas_ssh_port         = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.num_shell_tries      = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.nvmet_port_id        = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.replication_device   = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.report_discard_supported = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.reserved_percentage  = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.scst_target_driver   = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.storage_protocol     = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.target_helper        = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.target_ip_address    = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.target_port          = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.target_prefix        = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.target_protocol      = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.trace_flags          = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.use_chap_auth        = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.volume_clear         = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.volume_clear_size    = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] QuobyteHD.volumes_dir          = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.ssl      = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack quobyte-client[85919]: Reading configuration file: /etc/quobyte/client.cfg
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_notifications.driver = [] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_notifications.retry = -1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack quobyte-client[85919]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] oslo_messaging_notifications.transport_url = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] key_manager.fixed_key          = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.barbican_api_version  = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.barbican_endpoint     = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.barbican_endpoint_type = public {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.barbican_region_name  = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.cafile                = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.certfile              = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.collect_timing        = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.insecure              = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.keyfile               = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.number_of_retries     = 60 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.retry_delay           = 1 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.send_service_user_token = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.split_loggers         = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.timeout               = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.verify_ssl            = True {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican.verify_ssl_path       = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican_service_user.auth_section = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican_service_user.auth_type = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican_service_user.cafile   = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican_service_user.certfile = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican_service_user.collect_timing = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican_service_user.insecure = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican_service_user.keyfile  = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican_service_user.split_loggers = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] barbican_service_user.timeout  = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] vault.approle_role_id          = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] vault.approle_secret_id        = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] vault.kv_mountpoint            = secret {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] vault.kv_path                  = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] vault.kv_version               = 2 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] vault.namespace                = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] vault.root_token_id            = **** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] vault.ssl_ca_crt_file          = None {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] vault.timeout                  = 60.0 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] vault.use_ssl                  = False {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:47:47 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] ******************************************************************************** {{(pid=85702) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 03 23:47:47 devstack cinder-volume[85918]: DEBUG oslo_concurrency.processutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] CMD "mount.quobyte" returned: 1 in 0.158s {{(pid=85918) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:47 devstack cinder-volume[85918]: DEBUG oslo_concurrency.lockutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85918) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:47:47 devstack cinder-volume[85918]: DEBUG oslo_concurrency.lockutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85918) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:47:47 devstack cinder-volume[85918]: DEBUG cinder.volume.drivers.quobyte [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=85918) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:47:47 devstack cinder-volume[85918]: INFO cinder.volume.drivers.quobyte [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf ...
Jul 03 23:47:47 devstack cinder-volume[85918]: DEBUG oslo_concurrency.processutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d -c /etc/quobyte/client-cinder.cfg {{(pid=85918) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:47 devstack sudo[85924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d -c /etc/quobyte/client-cinder.cfg
Jul 03 23:47:47 devstack sudo[85924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:48 devstack sudo[85924]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:48 devstack cinder-volume[85918]: DEBUG oslo_concurrency.processutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.787s {{(pid=85918) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:48 devstack cinder-volume[85918]: INFO cinder.volume.drivers.quobyte [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf succeeded
Jul 03 23:47:48 devstack cinder-volume[85918]: DEBUG cinder.volume.drivers.quobyte [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=85918) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:47:48 devstack cinder-volume[85918]: DEBUG oslo_concurrency.lockutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.802s {{(pid=85918) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:47:48 devstack cinder-volume[85918]: DEBUG oslo_concurrency.processutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=85918) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:48 devstack sudo[85993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:47:48 devstack sudo[85993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:49 devstack sudo[85993]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:49 devstack cinder-volume[85918]: DEBUG oslo_concurrency.processutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.649s {{(pid=85918) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:49 devstack cinder-volume[85918]: INFO cinder.volume.driver [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Driver hasn't implemented _init_vendor_properties()
Jul 03 23:47:49 devstack cinder-volume[85918]: DEBUG cinder.volume.driver [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85918) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 03 23:47:49 devstack cinder-volume[85918]: DEBUG oslo_db.sqlalchemy.engines [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85918) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:47:49 devstack cinder-volume[85918]: DEBUG dbcounter [-] [85918] Writer thread running {{(pid=85918) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 23:47:49 devstack cinder-volume[85918]: DEBUG cinder.db.api [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Building query based on filter {{(pid=85918) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 03 23:47:49 devstack cinder-volume[85918]: DEBUG cinder.image.image_utils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85918) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 03 23:47:49 devstack cinder-volume[85918]: INFO cinder.keymgr.migration [None req-acc3977b-e2ea-4dc2-a545-8d1f5c59db0c None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 03 23:47:49 devstack cinder-volume[85918]: DEBUG oslo_concurrency.lockutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85918) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:47:49 devstack cinder-volume[85918]: DEBUG oslo_concurrency.lockutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85918) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:47:49 devstack cinder-volume[85918]: DEBUG cinder.volume.drivers.quobyte [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=85918) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:47:49 devstack cinder-volume[85918]: DEBUG cinder.volume.drivers.quobyte [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=85918) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:47:49 devstack cinder-volume[85918]: DEBUG oslo_concurrency.lockutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85918) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:47:49 devstack cinder-volume[85918]: DEBUG oslo_concurrency.processutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=85918) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:49 devstack sudo[85996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:47:49 devstack sudo[85996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:50 devstack sudo[85996]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:50 devstack cinder-volume[85918]: DEBUG oslo_concurrency.processutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.635s {{(pid=85918) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:50 devstack cinder-volume[85918]: DEBUG cinder.manager [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Notifying Schedulers of capabilities ... {{(pid=85918) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:47:50 devstack cinder-volume[85918]: INFO cinder.volume.manager [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Driver initialization completed successfully.
Jul 03 23:47:50 devstack cinder-volume[85918]: INFO cinder.manager [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Initiating service 3 cleanup
Jul 03 23:47:50 devstack cinder-volume[85918]: INFO cinder.manager [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Service 3 cleanup completed.
Jul 03 23:47:50 devstack cinder-volume[85918]: DEBUG cinder.service [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Creating RPC server for service cinder-volume {{(pid=85918) start /opt/stack/cinder/cinder/service.py:231}}
Jul 03 23:47:50 devstack cinder-volume[85918]: DEBUG cinder.service [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85918) start /opt/stack/cinder/cinder/service.py:237}}
Jul 03 23:47:50 devstack cinder-volume[85918]: INFO cinder.volume.manager [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 03 23:47:50 devstack cinder-volume[85918]: DEBUG oslo_concurrency.lockutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85918) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:47:50 devstack cinder-volume[85918]: DEBUG oslo_concurrency.lockutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85918) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:47:50 devstack cinder-volume[85918]: DEBUG cinder.volume.drivers.quobyte [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=85918) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:47:50 devstack cinder-volume[85918]: DEBUG cinder.volume.drivers.quobyte [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=85918) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:47:50 devstack cinder-volume[85918]: DEBUG oslo_concurrency.lockutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=85918) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:47:50 devstack cinder-volume[85918]: DEBUG oslo_concurrency.processutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=85918) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:50 devstack sudo[86014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:47:50 devstack sudo[86014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:51 devstack sudo[86014]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:51 devstack cinder-volume[85918]: DEBUG oslo_concurrency.processutils [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.849s {{(pid=85918) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:51 devstack cinder-volume[85918]: INFO cinder.volume.manager [None req-364d8c37-0010-4fc8-8036-ee2a48194c13 None None] Driver post RPC initialization completed successfully.
Jul 03 23:47:52 devstack cinder-volume[85918]: DEBUG oslo_service.periodic_task [None req-e617a315-c722-45c1-ab6c-1930ddb70ada None None] Running periodic task VolumeManager._thread_info {{(pid=85918) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:47:52 devstack cinder-volume[85918]: DEBUG cinder.volume.manager [None req-e617a315-c722-45c1-ab6c-1930ddb70ada None None] thread count: 6 {{(pid=85918) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:47:52 devstack cinder-volume[85918]: DEBUG cinder.volume.manager [None req-e617a315-c722-45c1-ab6c-1930ddb70ada None None] thread info: [<_MainThread(MainThread, started 136800848732288)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 136800739577856)>, <Thread(Thread-3 (stat_writer), started daemon 136800736485696)>, <Thread(Rabbit-heartbeat, started daemon 136800736851008)>, <Thread(Thread-5 (_runner), started daemon 136800734910656)>, <Thread(Thread-7 (_runner), started daemon 136800734914880)>] {{(pid=85918) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:47:55 devstack cinder-volume[85918]: DEBUG oslo_concurrency.lockutils [None req-1675c4d8-1908-448d-aac4-b75024a4d51f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85918) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:47:55 devstack cinder-volume[85918]: DEBUG oslo_concurrency.lockutils [None req-1675c4d8-1908-448d-aac4-b75024a4d51f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85918) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:47:55 devstack cinder-volume[85918]: DEBUG cinder.volume.drivers.quobyte [None req-1675c4d8-1908-448d-aac4-b75024a4d51f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=85918) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:47:55 devstack cinder-volume[85918]: DEBUG cinder.volume.drivers.quobyte [None req-1675c4d8-1908-448d-aac4-b75024a4d51f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=85918) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:47:55 devstack cinder-volume[85918]: DEBUG oslo_concurrency.lockutils [None req-1675c4d8-1908-448d-aac4-b75024a4d51f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85918) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:47:55 devstack cinder-volume[85918]: DEBUG oslo_concurrency.processutils [None req-1675c4d8-1908-448d-aac4-b75024a4d51f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=85918) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:47:55 devstack sudo[86216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:47:55 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:47:56 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root
Jul 03 23:47:56 devstack cinder-volume[85918]: DEBUG oslo_concurrency.processutils [None req-1675c4d8-1908-448d-aac4-b75024a4d51f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.668s {{(pid=85918) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:47:56 devstack cinder-volume[85918]: DEBUG cinder.manager [None req-1675c4d8-1908-448d-aac4-b75024a4d51f None None] Notifying Schedulers of capabilities ... {{(pid=85918) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:47:57 devstack cinder-volume[85702]: INFO oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Caught SIGTERM, stopping children
Jul 03 23:47:57 devstack cinder-volume[85702]: DEBUG oslo_concurrency.lockutils [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Acquiring lock "singleton_lock" {{(pid=85702) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 23:47:57 devstack cinder-volume[85702]: DEBUG oslo_concurrency.lockutils [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Acquired lock "singleton_lock" {{(pid=85702) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 23:47:57 devstack cinder-volume[85702]: DEBUG oslo_concurrency.lockutils [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Releasing lock "singleton_lock" {{(pid=85702) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 23:47:57 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Stop services. {{(pid=85702) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 03 23:47:57 devstack cinder-volume[85702]: DEBUG oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Killing children. {{(pid=85702) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 03 23:47:57 devstack cinder-volume[85702]: INFO oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Waiting on 1 children to exit
Jul 03 23:47:58 devstack cinder-volume[85918]: DEBUG oslo_concurrency.lockutils [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Acquiring lock "singleton_lock" {{(pid=85918) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 23:47:58 devstack cinder-volume[85918]: DEBUG oslo_concurrency.lockutils [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Acquired lock "singleton_lock" {{(pid=85918) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 23:47:58 devstack cinder-volume[85918]: DEBUG oslo_concurrency.lockutils [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Releasing lock "singleton_lock" {{(pid=85918) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 23:47:58 devstack cinder-volume[85918]: WARNING amqp [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 23:47:58 devstack cinder-volume[85918]: WARNING amqp [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 03 23:47:58 devstack cinder-volume[85702]: INFO oslo_service.backend._eventlet.service [None req-5f0ee5bf-0fe8-42d2-b988-7e611c8a336c None None] Child 85918 exited with status 0
Jul 03 23:47:59 devstack cinder-volume[86342]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 03 23:47:59 devstack cinder-volume[86342]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 23:47:59 devstack cinder-volume[86342]: we strongly recommend against using it for new projects.
Jul 03 23:47:59 devstack cinder-volume[86342]: If you are already using Eventlet, we recommend migrating to a different
Jul 03 23:47:59 devstack cinder-volume[86342]: framework.  For more detail see
Jul 03 23:47:59 devstack cinder-volume[86342]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 23:47:59 devstack cinder-volume[86342]:   import eventlet  # noqa
Jul 03 23:48:02 devstack cinder-volume[86342]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 03 23:48:02 devstack cinder-volume[86342]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 03 23:48:02 devstack cinder-volume[86342]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 03 23:48:03 devstack cinder-volume[86342]: INFO dbcounter [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] Registered counter for database cinder
Jul 03 23:48:03 devstack cinder-volume[86342]: DEBUG oslo_db.sqlalchemy.engines [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86342) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:48:03 devstack cinder-volume[86342]: DEBUG dbcounter [-] [86342] Writer thread running {{(pid=86342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 23:48:03 devstack cinder-volume[86342]: INFO cinder.rpc [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 03 23:48:03 devstack cinder-volume[86342]: INFO cinder.rpc [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_db.sqlalchemy.engines [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86342) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:48:04 devstack cinder-volume[86342]: INFO cinder.volume.manager [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] Determined volume DB was empty at startup.
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG cinder.volume.manager [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86342) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 03 23:48:04 devstack cinder-volume[86342]: WARNING stevedore.named [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 03 23:48:04 devstack cinder-volume[86342]: WARNING castellan.key_manager [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 23:48:04 devstack cinder-volume[86342]: WARNING cinder.keymgr.conf_key_mgr [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 03 23:48:04 devstack cinder-volume[86342]: INFO cinder.volume.manager [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_db.sqlalchemy.engines [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86342) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:48:04 devstack cinder-volume[86342]: INFO oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] Starting 1 workers
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] Started child 86650 {{(pid=86342) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] Full set of CONF: {{(pid=86342) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] ******************************************************************************** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] Configuration options gathered from: {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] ================================================================================ {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] allow_availability_zone_fallback = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] allow_compression_on_image_upload = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] allowed_direct_url_schemes     = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86650]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] api_rate_limit                 = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] auth_strategy                  = keystone {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_availability_zone      = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_host                   = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_name                   = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_stats_polling_interval = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backup_api_class               = cinder.backup.api.API {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backup_name_template           = backup-%s {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backup_use_same_host           = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backup_use_temp_snapshot       = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] chap_password                  = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] chap_username                  =  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cinder_internal_tenant_project_id = 157d44153e3443d0a283f0f3ed2fa3bd {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cinder_internal_tenant_user_id = f430159010d04fed8937ac8583e2634b {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cluster                        = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] compression_format             = gzip {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] compute_api_class              = cinder.compute.nova.API {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] config_dir                     = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] config_source                  = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] control_exchange               = openstack {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] debug                          = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] default_availability_zone      = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] default_group_type             = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] default_volume_type            = QuobyteHD {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] disk_geometry                  = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] driver_client_cert             = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] driver_client_cert_key         = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] driver_data_namespace          = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] driver_ssl_cert_path           = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] driver_ssl_cert_verify         = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] driver_use_ssl                 = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] enable_new_services            = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] enable_unsupported_driver      = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] enabled_backends               = ['QuobyteHD'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] enforce_multipath_for_image_xfer = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] filter_function                = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance_api_insecure            = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance_api_servers             = ['http://192.168.122.158/image'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance_api_ssl_compression     = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance_ca_certificates_file    = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance_catalog_info            = image:glance:publicURL {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance_certfile                = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance_keyfile                 = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance_num_retries             = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance_request_timeout         = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] goodness_function              = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] graceful_shutdown_timeout      = 5 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] group_api_class                = cinder.group.api.API {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] host                           = devstack {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] image_compress_on_upload       = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] image_conversion_address_space_limit = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] image_conversion_cpu_limit     = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] image_conversion_disable       = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] image_upload_use_cinder_backend = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] image_upload_use_internal_tenant = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] image_volume_cache_enabled     = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] image_volume_cache_max_count   = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] image_volume_cache_max_size_gb = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] init_host_max_objects_retrieval = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] instance_format                = [instance: %(uuid)s]  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] iscsi_target_flags             =  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] iscsi_write_cache              = on {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] iser_helper                    = tgtadm {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] iser_ip_address                = 192.168.122.158 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] iser_port                      = 3260 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] log_color                      = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] log_config_append              = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] log_dir                        = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] log_file                       = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] log_options                    = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] log_rotate_interval            = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] log_rotate_interval_type       = days {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] log_rotation_type              = none {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] max_age                        = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] max_logfile_count              = 30 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] max_logfile_size_mb            = 200 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] max_over_subscription_ratio    = 20.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] message_reap_interval          = 86400 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] message_ttl                    = 2592000 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] migration_create_volume_timeout_secs = 300 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] monkey_patch                   = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] monkey_patch_modules           = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] my_ip                          = 192.168.122.158 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] no_snapshot_gb_quota           = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] num_iser_scan_tries            = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] num_shell_tries                = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] num_volume_device_scan_tries   = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] nvmeof_conn_info_version       = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] nvmet_ns_id                    = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] nvmet_port_id                  = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] osapi_max_limit                = 1000 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] osapi_volume_ext_list          = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86650) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] osapi_volume_listen_port       = 8776 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] osapi_volume_use_ssl           = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] osapi_volume_workers           = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] per_volume_size_limit          = -1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] periodic_fuzzy_delay           = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] periodic_interval              = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] public_endpoint                = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] publish_errors                 = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] quota_backup_gigabytes         = 1000 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] quota_backups                  = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] quota_gigabytes                = 1000 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] quota_groups                   = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] quota_snapshots                = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] quota_volumes                  = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] rate_limit_burst               = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] rate_limit_except_level        = CRITICAL {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] rate_limit_interval            = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] reinit_driver_count            = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] replication_device             = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] report_discard_supported       = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] report_interval                = 120 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] reservation_clean_interval     = 86400 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] reservation_expire             = 86400 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] reserved_image_namespaces      = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] reserved_percentage            = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] rpc_response_timeout           = 120 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] run_external_periodic_tasks    = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] scst_target_driver             = iscsi {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] scst_target_iqn_name           = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] service_down_time              = 720 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] shell_completion               = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] snapshot_name_template         = snapshot-%s {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] split_loggers                  = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] state_path                     = /opt/stack/data/cinder {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] storage_availability_zone      = nova {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] storage_protocol               = iSCSI {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] syslog_log_facility            = LOG_USER {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] target_helper                  = lioadm {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] target_ip_address              = 192.168.122.158 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] target_port                    = 3260 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] target_protocol                = iscsi {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] target_secondary_ip_addresses  = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] trace_flags                    = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] transport_url                  = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] until_refresh                  = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] use_chap_auth                  = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] use_default_quota_class        = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] use_journal                    = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] use_json                       = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] use_multipath_for_image_xfer   = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] use_stderr                     = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] use_syslog                     = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] verify_glance_signatures       = enabled {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] volume_api_class               = cinder.volume.api.API {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] volume_backend_name            = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] volume_clear                   = zero {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] volume_clear_ionice            = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] volume_clear_size              = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] volume_copy_bps_limit          = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] volume_dd_blocksize            = 1M {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] volume_name_template           = volume-%s {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] volume_service_inithost_offload = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] volume_usage_audit_period      = month {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] zoning_mode                    = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_concurrency.disable_process_locking = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.auth_section = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.auth_type   = password {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.auth_version = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.cache       = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.certfile    = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.include_service_catalog = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.insecure    = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.interface   = public {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.keyfile     = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcache_password =  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcache_username =  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.region_name = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.service_type = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.158/identity {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.backend                  = dogpile.cache.null {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.backend_argument         = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.backend_expiration_time  = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.config_prefix            = cache.oslo {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.debug_cache_backend      = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.enable_retry_client      = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.enable_socket_keepalive  = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.enabled                  = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.expiration_time          = 600 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.hashclient_retry_attempts = 2 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.memcache_dead_retry      = 300 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.memcache_pool_maxsize    = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.memcache_sasl_enabled    = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.password                 = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.proxies                  = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.redis_db                 = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.redis_server             = localhost:6379 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.retry_attempts           = 2 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.retry_delay              = 0.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.socket_keepalive_count   = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.socket_keepalive_idle    = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.socket_keepalive_interval = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.socket_timeout           = 1.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.tls_allowed_ciphers      = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.tls_cafile               = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.tls_certfile             = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.tls_enabled              = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.tls_keyfile              = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cache.username                 = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] coordination.backend_url       = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.asyncio_connection    = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.asyncio_slave_connection = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.backend               = sqlalchemy {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.connection            = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.connection_debug      = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.connection_parameters =  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.connection_recycle_time = 3600 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.connection_trace      = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.db_inc_retry_interval = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.db_max_retries        = 20 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.db_max_retry_interval = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.db_retry_interval     = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.max_overflow          = 50 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.max_pool_size         = 5 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.max_retries           = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.mysql_wsrep_sync_wait = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.pool_timeout          = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.retry_interval        = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.slave_connection      = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.sqlite_synchronous    = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.synchronous_reader    = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] database.use_db_reconnect      = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] profiler.connection_string     = messaging:// {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] profiler.enabled               = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] profiler.es_doc_type           = notification {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] profiler.es_scroll_size        = 10000 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] profiler.es_scroll_time        = 2m {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] profiler.filter_error_trace    = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] profiler.hmac_keys             = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] profiler.sentinel_service_name = mymaster {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] profiler.socket_timeout        = 0.1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] profiler.trace_requests        = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] profiler.trace_sqlalchemy      = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] profiler_jaeger.process_tags   = {} {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] profiler_jaeger.service_name_prefix = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] profiler_otlp.service_name_prefix = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_policy.enforce_new_defaults = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_policy.enforce_scope      = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_policy.policy_default_rule = default {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_policy.policy_file        = policy.yaml {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] privsep_osbrick.group          = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] privsep_osbrick.helper_command = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] privsep_osbrick.user           = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cinder_sys_admin.group         = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cinder_sys_admin.helper_command = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] cinder_sys_admin.user          = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] service_user.auth_section      = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] service_user.auth_type         = password {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] service_user.cafile            = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] service_user.certfile          = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] service_user.collect_timing    = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] service_user.insecure          = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] service_user.keyfile           = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] service_user.send_service_user_token = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] service_user.split_loggers     = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] service_user.timeout           = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance.auth_section            = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance.auth_type               = password {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance.certfile                = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance.collect_timing          = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance.insecure                = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance.keyfile                 = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance.region_name             = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86650) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 03 23:48:04 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.quobyte [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 03 23:48:04 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.quobyte [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance.split_loggers           = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] glance.timeout                 = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Running cmd (subprocess): mount.quobyte {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.backend_availability_zone = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.chap_password = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.chap_username =  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.disk_geometry = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.driver_client_cert = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.driver_client_cert_key = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.driver_data_namespace = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.driver_use_ssl = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.extra_capabilities = {} {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.filter_function = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.goodness_function = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.iscsi_target_flags =  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.iscsi_write_cache = on {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.iser_helper   = tgtadm {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.iser_ip_address = 192.168.122.158 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.iser_port     = 3260 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.nas_host      =  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.nas_login     = admin {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.nas_mount_options = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.nas_password  = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.nas_private_key =  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.nas_share_path =  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.num_shell_tries = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.quobyte_volume_url = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.replication_device = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.report_discard_supported = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.reserved_percentage = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.target_helper = tgtadm {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.target_ip_address = 192.168.122.158 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.target_port   = 3260 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.target_protocol = iscsi {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.trace_flags   = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.unique_fqdn_network = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.use_chap_auth = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.volume_backend_name = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.volume_clear  = zero {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.volume_clear_ionice = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.volume_clear_size = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_reports.file_event_handler = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_reports.log_dir           = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.backend_availability_zone = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.backend_host         = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.chap_password        = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack quobyte-client[86654]: Reading configuration file: /etc/quobyte/client.cfg
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.chap_username        = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.chiscsi_conf         = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.disk_geometry        = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.driver_client_cert   = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.driver_data_namespace = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack quobyte-client[86654]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.driver_use_ssl       = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.extra_capabilities   = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.filter_function      = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.goodness_function    = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.iser_helper          = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.iser_ip_address      = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.iser_port            = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.iser_target_prefix   = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.nas_host             = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.nas_login            = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.nas_mount_options    = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.nas_password         = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.nas_private_key      = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.nas_share_path       = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.nas_ssh_port         = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.num_shell_tries      = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.nvmet_port_id        = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.replication_device   = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.report_discard_supported = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.reserved_percentage  = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.scst_target_driver   = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.storage_protocol     = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.target_helper        = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.target_ip_address    = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.target_port          = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.target_prefix        = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.target_protocol      = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] CMD "mount.quobyte" returned: 1 in 0.125s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:48:04 devstack sudo[86659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.trace_flags          = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:48:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.use_chap_auth        = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:04 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:48:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.volume_clear         = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.volume_clear_size    = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] QuobyteHD.volumes_dir          = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.ssl      = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_notifications.driver = [] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_notifications.retry = -1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] key_manager.fixed_key          = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.barbican_api_version  = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.barbican_endpoint     = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.barbican_endpoint_type = public {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.barbican_region_name  = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.cafile                = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.certfile              = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.collect_timing        = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.insecure              = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.keyfile               = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.number_of_retries     = 60 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.retry_delay           = 1 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.send_service_user_token = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.split_loggers         = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.timeout               = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.verify_ssl            = True {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican.verify_ssl_path       = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican_service_user.auth_section = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican_service_user.auth_type = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican_service_user.cafile   = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican_service_user.certfile = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican_service_user.collect_timing = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican_service_user.insecure = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican_service_user.keyfile  = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican_service_user.split_loggers = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] barbican_service_user.timeout  = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] vault.approle_role_id          = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] vault.approle_secret_id        = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] vault.kv_mountpoint            = secret {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] vault.kv_path                  = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] vault.kv_version               = 2 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] vault.namespace                = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] vault.root_token_id            = **** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] vault.ssl_ca_crt_file          = None {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] vault.timeout                  = 60.0 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] vault.use_ssl                  = False {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 03 23:48:05 devstack cinder-volume[86342]: DEBUG oslo_service.backend._eventlet.service [None req-361fbe1a-6a4f-46d0-a9f7-a2333ef3714f None None] ******************************************************************************** {{(pid=86342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 03 23:48:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.972s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:48:05 devstack cinder-volume[86650]: INFO cinder.volume.driver [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Driver hasn't implemented _init_vendor_properties()
Jul 03 23:48:05 devstack cinder-volume[86650]: DEBUG cinder.volume.driver [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86650) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 03 23:48:05 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root
Jul 03 23:48:05 devstack cinder-volume[86650]: DEBUG oslo_db.sqlalchemy.engines [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86650) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 03 23:48:05 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writer thread running {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 03 23:48:05 devstack cinder-volume[86650]: DEBUG cinder.db.api [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Building query based on filter {{(pid=86650) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86650) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:48:06 devstack cinder-volume[86650]: INFO cinder.keymgr.migration [None req-58855e93-8123-4cab-a5a2-0c6220edeb52 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 03 23:48:06 devstack sudo[86668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:48:06 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:48:06 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.650s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:48:06 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Driver initialization completed successfully.
Jul 03 23:48:06 devstack cinder-volume[86650]: INFO cinder.manager [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Initiating service 3 cleanup
Jul 03 23:48:06 devstack cinder-volume[86650]: INFO cinder.manager [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Service 3 cleanup completed.
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG cinder.service [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Creating RPC server for service cinder-volume {{(pid=86650) start /opt/stack/cinder/cinder/service.py:231}}
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG cinder.service [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86650) start /opt/stack/cinder/cinder/service.py:237}}
Jul 03 23:48:06 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:48:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:48:06 devstack sudo[86672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:48:06 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:48:07 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root
Jul 03 23:48:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.591s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:48:07 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f2175f86-9bae-48b4-b632-33f264bf5d2f None None] Driver post RPC initialization completed successfully.
Jul 03 23:48:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:48:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 6 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:48:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:48:14 devstack cinder-volume[86342]: DEBUG dbcounter [-] [86342] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:48:16 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:48:17 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:49:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:49:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:49:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:49:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:14 devstack sudo[87122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:49:14 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:15 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.961s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:49:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:49:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 6 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:49:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:49:32 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Flow 'volume_create_manager' (8f230246-c3d6-413e-abd3-75c049e23a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0365cd15-fa46-4e22-8168-523bc1914139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0365cd15-fa46-4e22-8168-523bc1914139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1057936864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5f635b-67e5-409e-a898-8be191dd158c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd08815ba604a3a803c30461eea8f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:49:33Z,use_quota=True,user_id='c845481108fc4cdba0e7cd7851772909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca72cd0-a75e-4956-9b35-e4b095a86a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca72cd0-a75e-4956-9b35-e4b095a86a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e11443db-791c-49ac-b96e-b0b03decf984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e11443db-791c-49ac-b96e-b0b03decf984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f5f635b-67e5-409e-a898-8be191dd158c', 'volume_name': 'volume-5f5f635b-67e5-409e-a898-8be191dd158c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7960193-4024-4d09-aa54-2782eac142a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7960193-4024-4d09-aa54-2782eac142a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8078950-954f-452c-a3ff-38ed6ec9d62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:33 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Volume 5f5f635b-67e5-409e-a898-8be191dd158c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f5f635b-67e5-409e-a898-8be191dd158c', 'volume_size': 1}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1057936864',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f5f635b-67e5-409e-a898-8be191dd158c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccd08815ba604a3a803c30461eea8f59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:49:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:49:33Z,use_quota=True,user_id='c845481108fc4cdba0e7cd7851772909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Creating volume 5f5f635b-67e5-409e-a898-8be191dd158c {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:49:33 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:49:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5f5f635b-67e5-409e-a898-8be191dd158c 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:33 devstack sudo[87370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5f5f635b-67e5-409e-a898-8be191dd158c 1073741824
Jul 03 23:49:33 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2b186ea2-4deb-4f0c-acb1-4c9cc213fa64 tempest-BackendsCapabilitiesAdminTestsJSON-310173548 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86650) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 03 23:49:36 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5f5f635b-67e5-409e-a898-8be191dd158c 1073741824" returned: 0 in 2.462s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5f5f635b-67e5-409e-a898-8be191dd158c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:36 devstack sudo[87694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5f5f635b-67e5-409e-a898-8be191dd158c
Jul 03 23:49:36 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fe615635-d022-47f2-99c3-1d378324f634 tempest-BackendsCapabilitiesAdminTestsJSON-310173548 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86650) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 03 23:49:37 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:49:37 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Flow 'volume_create_manager' (266c7b3d-6a14-4794-b8a7-718834efb76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a91ac8-0e6e-4b74-9e14-865665e1db2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5f5f635b-67e5-409e-a898-8be191dd158c" returned: 0 in 1.951s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] <== create_volume: return (4575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.598s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6a91ac8-0e6e-4b74-9e14-865665e1db2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1463451550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ee2969-9a1d-4bf4-84eb-93246e71612c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39aa2ac589549e58af5dc7a25df233e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:49:38Z,use_quota=True,user_id='ac06ba91dff947a681e64a4ba55cce70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9560065-f44e-42c3-95dc-9515189be9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9560065-f44e-42c3-95dc-9515189be9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7377d13-c311-494e-8722-6222a53177fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7377d13-c311-494e-8722-6222a53177fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4ee2969-9a1d-4bf4-84eb-93246e71612c', 'volume_name': 'volume-d4ee2969-9a1d-4bf4-84eb-93246e71612c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c6798f-2de1-47b9-8227-d99d9fa6e9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7c6798f-2de1-47b9-8227-d99d9fa6e9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbde6515-a127-40dc-8834-b1f202758b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:38 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Volume d4ee2969-9a1d-4bf4-84eb-93246e71612c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4ee2969-9a1d-4bf4-84eb-93246e71612c', 'volume_size': 1}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1463451550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4ee2969-9a1d-4bf4-84eb-93246e71612c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f39aa2ac589549e58af5dc7a25df233e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:49:38Z,use_quota=True,user_id='ac06ba91dff947a681e64a4ba55cce70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Creating volume d4ee2969-9a1d-4bf4-84eb-93246e71612c {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:49:38 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d4ee2969-9a1d-4bf4-84eb-93246e71612c 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:38 devstack sudo[87701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d4ee2969-9a1d-4bf4-84eb-93246e71612c 1073741824
Jul 03 23:49:38 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8078950-954f-452c-a3ff-38ed6ec9d62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f5f635b-67e5-409e-a898-8be191dd158c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad4c9f1-9955-4bf9-8721-defcfb9be156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:38 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Volume volume-5f5f635b-67e5-409e-a898-8be191dd158c (5f5f635b-67e5-409e-a898-8be191dd158c): created successfully
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad4c9f1-9955-4bf9-8721-defcfb9be156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Flow 'volume_create_manager' (8f230246-c3d6-413e-abd3-75c049e23a0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:49:38 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-334d172b-8ac8-4f96-b3a9-a4604f5934d3 tempest-DeleteServersTestJSON-2021437013 None] Created volume successfully.
Jul 03 23:49:40 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d4ee2969-9a1d-4bf4-84eb-93246e71612c 1073741824" returned: 0 in 1.896s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d4ee2969-9a1d-4bf4-84eb-93246e71612c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:40 devstack sudo[87710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d4ee2969-9a1d-4bf4-84eb-93246e71612c
Jul 03 23:49:40 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:41 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d4ee2969-9a1d-4bf4-84eb-93246e71612c" returned: 0 in 1.400s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:41 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] <== create_volume: return (3423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:49:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.426s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbde6515-a127-40dc-8834-b1f202758b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4ee2969-9a1d-4bf4-84eb-93246e71612c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58e7c7c-c9c8-4987-ba22-d9ba11f6fb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:41 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Volume volume-d4ee2969-9a1d-4bf4-84eb-93246e71612c (d4ee2969-9a1d-4bf4-84eb-93246e71612c): created successfully
Jul 03 23:49:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58e7c7c-c9c8-4987-ba22-d9ba11f6fb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Flow 'volume_create_manager' (266c7b3d-6a14-4794-b8a7-718834efb76d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:49:42 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-de13085e-c0cd-4446-9183-8e96314f548c tempest-VolumesAdminNegativeTest-1265316031 None] Created volume successfully.
Jul 03 23:49:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Acquiring lock "cinder-d4ee2969-9a1d-4bf4-84eb-93246e71612c-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:49:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Lock "cinder-d4ee2969-9a1d-4bf4-84eb-93246e71612c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:49:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Acquiring lock "cinder-quobyte-d4ee2969-9a1d-4bf4-84eb-93246e71612c" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:49:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Lock "cinder-quobyte-d4ee2969-9a1d-4bf4-84eb-93246e71612c" acquired by "delete_volume" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:49:44 devstack cinder-volume[86650]: INFO oslo.privsep.daemon [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2_akx4da/privsep.sock']
Jul 03 23:49:44 devstack sudo[87729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2_akx4da/privsep.sock
Jul 03 23:49:44 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:45 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jul 03 23:49:45 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 23:49:45 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 03 23:49:45 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 23:49:45 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 03 23:49:45 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 03 23:49:45 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 23:49:45 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 23:49:45 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jul 03 23:49:46 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jul 03 23:49:46 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 03 23:49:46 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 03 23:49:46 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 23:49:46 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 03 23:49:46 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 03 23:49:46 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 03 23:49:46 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 03 23:49:46 devstack cinder-volume[86650]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jul 03 23:49:47 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:47 devstack cinder-volume[86650]: INFO oslo.privsep.daemon [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Spawned new privsep daemon via rootwrap
Jul 03 23:49:47 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Accepted privsep connection to /tmp/tmp2_akx4da/privsep.sock {{(pid=86650) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 03 23:49:47 devstack cinder-volume[86650]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 03 23:49:47 devstack cinder-volume[86650]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 03 23:49:47 devstack cinder-volume[86650]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 03 23:49:47 devstack cinder-volume[86650]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87748
Jul 03 23:49:47 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca03c928-d439-4732-9a3f-120796b20bb1]: (2,) {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:49:47 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[41551eb7-ebaa-41b3-ba05-d13b00e9b027]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:49:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d4ee2969-9a1d-4bf4-84eb-93246e71612c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:47 devstack sudo[87762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d4ee2969-9a1d-4bf4-84eb-93246e71612c
Jul 03 23:49:47 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:49 devstack cinder-volume[86650]: WARNING py.warnings [req-682c3be6-f322-4e31-a500-578bbba0bf95 req-6f57f857-053d-4ca0-87d8-48a78ba8eedb tempest-DeleteServersTestJSON-2021437013 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1".  Apply join condition(s) between each element to resolve.
Jul 03 23:49:49 devstack cinder-volume[86650]:   .first()
Jul 03 23:49:49 devstack cinder-volume[86650]: 
Jul 03 23:49:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-682c3be6-f322-4e31-a500-578bbba0bf95 req-6f57f857-053d-4ca0-87d8-48a78ba8eedb tempest-DeleteServersTestJSON-2021437013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-682c3be6-f322-4e31-a500-578bbba0bf95 req-6f57f857-053d-4ca0-87d8-48a78ba8eedb tempest-DeleteServersTestJSON-2021437013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:49 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b4798f-15ed-4856-b473-911c6bee58b8]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:49:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-682c3be6-f322-4e31-a500-578bbba0bf95 req-6f57f857-053d-4ca0-87d8-48a78ba8eedb tempest-DeleteServersTestJSON-2021437013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5f5f635b-67e5-409e-a898-8be191dd158c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:49 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d4ee2969-9a1d-4bf4-84eb-93246e71612c" returned: 0 in 1.878s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d4ee2969-9a1d-4bf4-84eb-93246e71612c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:49 devstack sudo[87794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5f5f635b-67e5-409e-a898-8be191dd158c
Jul 03 23:49:49 devstack sudo[87794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:49 devstack sudo[87797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d4ee2969-9a1d-4bf4-84eb-93246e71612c
Jul 03 23:49:49 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:50 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d4ee2969-9a1d-4bf4-84eb-93246e71612c" returned: 0 in 1.163s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:50 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Lock "cinder-quobyte-d4ee2969-9a1d-4bf4-84eb-93246e71612c" released by "delete_volume" :: held 6.311s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:49:50 devstack cinder-volume[86650]: WARNING cinder.quota [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:49:50 devstack cinder-volume[86650]: WARNING cinder.quota [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:49:50 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Created reservations ['e02935d0-9c53-49d5-a2f7-4dd1700e288d', '934d0da3-8562-4cf3-864a-3146fbd24c98', '8d8db8c6-0424-469c-984f-e6ca39b32f8f', '409774fc-a08b-4722-b991-741f5a6186f6'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:49:51 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f2e63e2f-73d0-481f-8b52-a543c5529d77 tempest-GroupSnapshotsTest-1854254363 None] Group tempest-GroupSnapshotsTest-Group-1199447130: creating
Jul 03 23:49:51 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f2e63e2f-73d0-481f-8b52-a543c5529d77 tempest-GroupSnapshotsTest-1854254363 None] Group tempest-GroupSnapshotsTest-Group-1199447130: created successfully
Jul 03 23:49:51 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f2e63e2f-73d0-481f-8b52-a543c5529d77 tempest-GroupSnapshotsTest-1854254363 None] Create group completed successfully.
Jul 03 23:49:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:49:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:49:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:51 devstack sudo[87794]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:51 devstack sudo[87809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:49:51 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-682c3be6-f322-4e31-a500-578bbba0bf95 req-6f57f857-053d-4ca0-87d8-48a78ba8eedb tempest-DeleteServersTestJSON-2021437013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5f5f635b-67e5-409e-a898-8be191dd158c" returned: 0 in 2.250s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-682c3be6-f322-4e31-a500-578bbba0bf95 req-6f57f857-053d-4ca0-87d8-48a78ba8eedb tempest-DeleteServersTestJSON-2021437013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.300s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-682c3be6-f322-4e31-a500-578bbba0bf95 req-6f57f857-053d-4ca0-87d8-48a78ba8eedb tempest-DeleteServersTestJSON-2021437013 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-5f5f635b-67e5-409e-a898-8be191dd158c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05f96365-8d17-4b9e-ae77-4bc9e3ae0d1b', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:49:51 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-682c3be6-f322-4e31-a500-578bbba0bf95 req-6f57f857-053d-4ca0-87d8-48a78ba8eedb tempest-DeleteServersTestJSON-2021437013 None] attachment_update completed successfully.
Jul 03 23:49:52 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.367s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:52 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:49:52 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Deleted volume successfully.
Jul 03 23:49:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-83f641d3-7fd0-4f08-afce-f53595262c9c tempest-VolumesAdminNegativeTest-1265316031 None] Lock "cinder-d4ee2969-9a1d-4bf4-84eb-93246e71612c-delete_volume" released by "delete_volume" :: held 8.613s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:49:52 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:49:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Flow 'volume_create_manager' (4b93ea15-598e-439e-b8e3-c16fad206324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:49:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85c7d0b-0706-4d2c-87c2-9519ea4601f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b85c7d0b-0706-4d2c-87c2-9519ea4601f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-743983387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=afc25983-3751-470e-8f70-074ce4315a6d,host='devstack@QuobyteHD#QuobyteHD',id=24f73e53-83ed-4dd7-b9af-5ef82f454ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247ea0e31bd842aabd3ea9cfb523db33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:49:53Z,use_quota=True,user_id='c9f7786595534301a9dc5ebe60cfa882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788ad2b6-6e79-48fb-81d4-ca6a111a1877),volume_type_id=788ad2b6-6e79-48fb-81d4-ca6a111a1877)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c093e9-7bfa-4a47-bf48-74a63d3a5ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c093e9-7bfa-4a47-bf48-74a63d3a5ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670655e7-d5b6-4fcb-b31e-27629ba0fb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670655e7-d5b6-4fcb-b31e-27629ba0fb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24f73e53-83ed-4dd7-b9af-5ef82f454ce1', 'volume_name': 'volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b897459c-8b96-4a75-93ab-580dfb4be0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b897459c-8b96-4a75-93ab-580dfb4be0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a34b410-b5a9-423a-88ef-e4d559b446d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:53 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Volume 24f73e53-83ed-4dd7-b9af-5ef82f454ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1', 'volume_size': 1}
Jul 03 23:49:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=afc25983-3751-470e-8f70-074ce4315a6d,created_at=2026-07-03T21:49:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-743983387',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=afc25983-3751-470e-8f70-074ce4315a6d,host='devstack@QuobyteHD#QuobyteHD',id=24f73e53-83ed-4dd7-b9af-5ef82f454ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247ea0e31bd842aabd3ea9cfb523db33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:49:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:49:53Z,use_quota=True,user_id='c9f7786595534301a9dc5ebe60cfa882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(788ad2b6-6e79-48fb-81d4-ca6a111a1877),volume_type_id=788ad2b6-6e79-48fb-81d4-ca6a111a1877)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:49:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Creating volume 24f73e53-83ed-4dd7-b9af-5ef82f454ce1 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:49:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:49:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:49:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:49:53 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:49:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:53 devstack sudo[87880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 1073741824
Jul 03 23:49:53 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:54 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:49:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Flow 'volume_create_manager' (2ba4761d-698e-4b95-88a6-5b533339b3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:49:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c84ca48-97e2-41a8-a61c-e09c6a364c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c84ca48-97e2-41a8-a61c-e09c6a364c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1880508318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870e207c-8b91-441a-890d-87036400f348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6e7ec436c44d938dcfe585a2f163a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:49:54Z,use_quota=True,user_id='b23991c522bf48d2b8ec54cfd7610087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f78c5f-e429-4070-987f-8544d50a5f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f78c5f-e429-4070-987f-8544d50a5f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85064b1d-7573-413a-9d99-ed64dfe0859d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85064b1d-7573-413a-9d99-ed64dfe0859d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '870e207c-8b91-441a-890d-87036400f348', 'volume_name': 'volume-870e207c-8b91-441a-890d-87036400f348', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aeb01f6-8b12-49c7-a947-0784e9cb7c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aeb01f6-8b12-49c7-a947-0784e9cb7c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7def0a-6f6b-4235-9f5e-a345b83407cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:54 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Volume 870e207c-8b91-441a-890d-87036400f348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-870e207c-8b91-441a-890d-87036400f348', 'volume_size': 1}
Jul 03 23:49:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:54 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 1073741824" returned: 0 in 1.764s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:54 devstack sudo[88267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1
Jul 03 23:49:54 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:55 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1" returned: 0 in 0.756s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] <== create_volume: return (2624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.627s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.507s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:49:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1880508318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870e207c-8b91-441a-890d-87036400f348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e6e7ec436c44d938dcfe585a2f163a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:49:54Z,use_quota=True,user_id='b23991c522bf48d2b8ec54cfd7610087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Creating volume 870e207c-8b91-441a-890d-87036400f348 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:49:55 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-870e207c-8b91-441a-890d-87036400f348 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a34b410-b5a9-423a-88ef-e4d559b446d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:55 devstack sudo[88276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-870e207c-8b91-441a-890d-87036400f348 1073741824
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99764a73-2bef-4d30-aa05-13eb4fe2e91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:55 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:55 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Volume volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 (24f73e53-83ed-4dd7-b9af-5ef82f454ce1): created successfully
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99764a73-2bef-4d30-aa05-13eb4fe2e91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Flow 'volume_create_manager' (4b93ea15-598e-439e-b8e3-c16fad206324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:49:55 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ed875a21-f4ec-4d5c-84b3-0a5165de7962 tempest-GroupSnapshotsTest-1854254363 None] Created volume successfully.
Jul 03 23:49:57 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-870e207c-8b91-441a-890d-87036400f348 1073741824" returned: 0 in 1.475s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-870e207c-8b91-441a-890d-87036400f348 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:57 devstack sudo[88284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-870e207c-8b91-441a-890d-87036400f348
Jul 03 23:49:57 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:49:57 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] GroupSnapshot f5ad18bd-c702-4118-88d4-47c26e3b54f1: creating.
Jul 03 23:49:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] Group snapshot f5ad18bd-c702-4118-88d4-47c26e3b54f1: creating. {{(pid=86650) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 23:49:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:49:58 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root
Jul 03 23:49:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-870e207c-8b91-441a-890d-87036400f348" returned: 0 in 1.168s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:49:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] <== create_volume: return (2719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:49:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.722s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:49:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.542s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:49:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a7def0a-6f6b-4235-9f5e-a345b83407cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-870e207c-8b91-441a-890d-87036400f348', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bd2b9e-c676-4570-a5ba-e6f3bea235f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:49:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] Creating offline snapshot 98d94062-646c-4068-aeb4-d7b7d5fa30d0 of volume 24f73e53-83ed-4dd7-b9af-5ef82f454ce1 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:49:58 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Volume volume-870e207c-8b91-441a-890d-87036400f348 (870e207c-8b91-441a-890d-87036400f348): created successfully
Jul 03 23:49:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bd2b9e-c676-4570-a5ba-e6f3bea235f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:49:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Flow 'volume_create_manager' (2ba4761d-698e-4b95-88a6-5b533339b3c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:49:58 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fde413a-1ef5-4cdd-822e-4fb0c6a1ba12]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:49:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:49:58 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-313a7de6-4a78-4451-b9f7-08fca0cf926e tempest-ServerRescueNegativeTestJSON-666368097 None] Created volume successfully.
Jul 03 23:49:58 devstack sudo[88290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1
Jul 03 23:49:58 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:00 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1" returned: 0 in 1.646s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:00 devstack sudo[88342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0 1G
Jul 03 23:50:00 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:01 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0 1G" returned: 0 in 1.854s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:02 devstack sudo[88353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0
Jul 03 23:50:02 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:02 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-51a441af-8af3-44ae-8122-ddd2246f4d07 req-085f08e7-f3bc-4e39-8b80-d4b2c1c5750c tempest-DeleteServersTestJSON-2021437013 None] Terminate volume connection completed successfully.
Jul 03 23:50:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-51a441af-8af3-44ae-8122-ddd2246f4d07 req-085f08e7-f3bc-4e39-8b80-d4b2c1c5750c tempest-DeleteServersTestJSON-2021437013 None] Deleting attachment 05f96365-8d17-4b9e-ae77-4bc9e3ae0d1b. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:50:03 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0" returned: 0 in 1.787s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:03 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:50:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:03 devstack sudo[88360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0
Jul 03 23:50:03 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:04 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0" returned: 0 in 1.052s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:04 devstack sudo[88366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.info
Jul 03 23:50:04 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:05 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.info" returned: 0 in 1.116s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:06 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:50:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:06 devstack sudo[88374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.info
Jul 03 23:50:06 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:07 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.info" returned: 0 in 1.479s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.137s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Acquiring lock "cinder-5f5f635b-67e5-409e-a898-8be191dd158c-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Lock "cinder-5f5f635b-67e5-409e-a898-8be191dd158c-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Acquiring lock "cinder-quobyte-5f5f635b-67e5-409e-a898-8be191dd158c" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Lock "cinder-quobyte-5f5f635b-67e5-409e-a898-8be191dd158c" acquired by "delete_volume" :: waited 0.035s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:07 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-dd8c7d8d-a126-4569-af4e-1f3ed79b26e0 tempest-GroupSnapshotsTest-1854254363 None] group_snapshot f5ad18bd-c702-4118-88d4-47c26e3b54f1: created successfully
Jul 03 23:50:07 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f019d8-4053-49d6-ae98-1eb6934650ef]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:50:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5f5f635b-67e5-409e-a898-8be191dd158c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:08 devstack sudo[88409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5f5f635b-67e5-409e-a898-8be191dd158c
Jul 03 23:50:08 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:08 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5f5f635b-67e5-409e-a898-8be191dd158c" returned: 0 in 1.046s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5f5f635b-67e5-409e-a898-8be191dd158c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:08 devstack sudo[88438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5f5f635b-67e5-409e-a898-8be191dd158c
Jul 03 23:50:08 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:09 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5f5f635b-67e5-409e-a898-8be191dd158c" returned: 0 in 0.836s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Lock "cinder-quobyte-5f5f635b-67e5-409e-a898-8be191dd158c" released by "delete_volume" :: held 1.962s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:09 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Created reservations ['b25587c2-3cad-42ab-ac26-2509d609755b', 'f689b36a-8141-4f0c-8120-6e2c2d8a1958', 'aee2eade-0c1b-4dea-955a-5cb5d810c3ae', '0ca15f9d-e890-49f1-96c8-3b9212bc0db6'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:50:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:09 devstack sudo[88442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:50:09 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "cinder-quobyte-98d94062-646c-4068-aeb4-d7b7d5fa30d0-9b02501b-ec80-4b1a-a134-e4dfb00a95b5" by "_create_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-98d94062-646c-4068-aeb4-d7b7d5fa30d0-9b02501b-ec80-4b1a-a134-e4dfb00a95b5" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Creating volume 9b02501b-ec80-4b1a-a134-e4dfb00a95b5 from snapshot 98d94062-646c-4068-aeb4-d7b7d5fa30d0 {{(pid=86650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "cinder-quobyte-9b02501b-ec80-4b1a-a134-e4dfb00a95b5" by "_copy_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-9b02501b-ec80-4b1a-a134-e4dfb00a95b5" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] snapshot: 98d94062-646c-4068-aeb4-d7b7d5fa30d0, volume: 9b02501b-ec80-4b1a-a134-e4dfb00a95b5,  {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eaf9f0-5fe2-48e1-8178-f92213e95488]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:50:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:10 devstack sudo[88444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0
Jul 03 23:50:10 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:11 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.303s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:11 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:50:11 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Deleted volume successfully.
Jul 03 23:50:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea4e7110-41ff-490b-a08a-459e42291c23 tempest-DeleteServersTestJSON-2021437013 None] Lock "cinder-5f5f635b-67e5-409e-a898-8be191dd158c-delete_volume" released by "delete_volume" :: held 3.677s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:11 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0" returned: 0 in 1.290s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:50:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] will copy from snapshot at /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 23:50:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Creating direct copy from snapshot {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 23:50:11 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[211199d9-f983-4d99-bfb5-4bbe878e15d7]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:50:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:11 devstack sudo[88474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1
Jul 03 23:50:11 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:12 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1" returned: 0 in 1.129s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:12 devstack cinder-volume[86650]: DEBUG cinder.utils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Path /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9b02501b-ec80-4b1a-a134-e4dfb00a95b5 not found in is_blk_device check {{(pid=86650) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 23:50:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9b02501b-ec80-4b1a-a134-e4dfb00a95b5 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:12 devstack sudo[88482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9b02501b-ec80-4b1a-a134-e4dfb00a95b5
Jul 03 23:50:12 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:50:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:14 devstack sudo[88492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:50:14 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:17 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 3.044s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:17 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:50:17 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:50:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 8 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:50:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:50:20 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=36,cinder:INSERT=8,cinder:UPDATE=32,cinder:DELETE=3 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:50:21 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=34,cinder:SELECT=34,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:50:23 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9b02501b-ec80-4b1a-a134-e4dfb00a95b5" returned: 0 in 10.451s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:23 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[004d72c6-26dd-4827-8bfd-ad0727341549]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:50:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:23 devstack sudo[88518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1
Jul 03 23:50:23 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:24 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1" returned: 0 in 1.503s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:24 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Image conversion details: src /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1, size 1024.00 MB, duration 10.45 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9b02501b-ec80-4b1a-a134-e4dfb00a95b5 {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 23:50:24 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Converted 1024.00 MB image at 97.97 MB/s
Jul 03 23:50:24 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9b02501b-ec80-4b1a-a134-e4dfb00a95b5 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:50:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9b02501b-ec80-4b1a-a134-e4dfb00a95b5 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:24 devstack sudo[88524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9b02501b-ec80-4b1a-a134-e4dfb00a95b5
Jul 03 23:50:24 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:25 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9b02501b-ec80-4b1a-a134-e4dfb00a95b5" returned: 0 in 1.000s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:25 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-9b02501b-ec80-4b1a-a134-e4dfb00a95b5" released by "_copy_volume_from_snapshot" :: held 15.545s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:25 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-98d94062-646c-4068-aeb4-d7b7d5fa30d0-9b02501b-ec80-4b1a-a134-e4dfb00a95b5" released by "_create_volume_from_snapshot" :: held 15.605s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.633s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:26 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-4421c11f-187f-4887-a4c0-6d7f4e6317ca tempest-GroupSnapshotsTest-1854254363 None] Create group from source-snapshot-f5ad18bd-c702-4118-88d4-47c26e3b54f1 completed successfully.
Jul 03 23:50:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "cinder-quobyte-9b02501b-ec80-4b1a-a134-e4dfb00a95b5" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-9b02501b-ec80-4b1a-a134-e4dfb00a95b5" acquired by "delete_volume" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:27 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e074aa82-595e-41d3-9b41-7dd8974fa514]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:50:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9b02501b-ec80-4b1a-a134-e4dfb00a95b5 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:27 devstack sudo[88562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9b02501b-ec80-4b1a-a134-e4dfb00a95b5
Jul 03 23:50:27 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:29 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9b02501b-ec80-4b1a-a134-e4dfb00a95b5" returned: 0 in 1.552s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9b02501b-ec80-4b1a-a134-e4dfb00a95b5 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:29 devstack sudo[88568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9b02501b-ec80-4b1a-a134-e4dfb00a95b5
Jul 03 23:50:29 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Acquiring lock "cinder-870e207c-8b91-441a-890d-87036400f348-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Lock "cinder-870e207c-8b91-441a-890d-87036400f348-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Acquiring lock "cinder-quobyte-870e207c-8b91-441a-890d-87036400f348" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Lock "cinder-quobyte-870e207c-8b91-441a-890d-87036400f348" acquired by "delete_volume" :: waited 0.031s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:30 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e8a463-0c0f-4ddf-886d-338018d26898]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:50:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-870e207c-8b91-441a-890d-87036400f348 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:30 devstack sudo[88572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-870e207c-8b91-441a-890d-87036400f348
Jul 03 23:50:30 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:30 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9b02501b-ec80-4b1a-a134-e4dfb00a95b5" returned: 0 in 1.425s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-9b02501b-ec80-4b1a-a134-e4dfb00a95b5" released by "delete_volume" :: held 3.065s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:30 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Created reservations ['4b251cdc-e20e-4dae-b761-9713419e6a9f'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:50:30 devstack cinder-volume[86650]: WARNING cinder.quota [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1736291755 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1736291755, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:50:30 devstack cinder-volume[86650]: WARNING cinder.quota [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1736291755 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1736291755, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:50:30 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Created reservations ['0e90e623-35c2-4ba7-a7c7-82e6b82b0c3d', 'd4aba059-5c3e-4bb7-8bef-3912bcdc3505', 'd23bea0b-ade1-4b5d-af0b-815723a54c1a', 'a5b2e30e-058c-428d-afdc-a9ef52337634'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:50:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:31 devstack sudo[88575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:50:31 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:31 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] group_snapshot f5ad18bd-c702-4118-88d4-47c26e3b54f1: deleting
Jul 03 23:50:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] group_snapshot f5ad18bd-c702-4118-88d4-47c26e3b54f1: deleting {{(pid=86650) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 23:50:32 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "cinder-quobyte-24f73e53-83ed-4dd7-b9af-5ef82f454ce1" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-870e207c-8b91-441a-890d-87036400f348" returned: 0 in 1.753s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-870e207c-8b91-441a-890d-87036400f348 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-24f73e53-83ed-4dd7-b9af-5ef82f454ce1" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "cinder-quobyte-98d94062-646c-4068-aeb4-d7b7d5fa30d0" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:32 devstack sudo[88580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-870e207c-8b91-441a-890d-87036400f348
Jul 03 23:50:32 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-98d94062-646c-4068-aeb4-d7b7d5fa30d0" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:32 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] Deleting offline snapshot 98d94062-646c-4068-aeb4-d7b7d5fa30d0 of volume 24f73e53-83ed-4dd7-b9af-5ef82f454ce1 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:50:32 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] snapshot_file for this snap is: volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:50:32 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c314fc3b-521f-40d0-984d-df902c1ec2cc]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:50:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:32 devstack sudo[88582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0
Jul 03 23:50:32 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:32 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.770s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:32 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:50:32 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e8cb605e-6f91-486e-b8ec-e6009d0f3cd6 tempest-GroupSnapshotsTest-1854254363 None] Delete group completed successfully.
Jul 03 23:50:33 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-870e207c-8b91-441a-890d-87036400f348" returned: 0 in 1.373s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Lock "cinder-quobyte-870e207c-8b91-441a-890d-87036400f348" released by "delete_volume" :: held 3.241s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:33 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Created reservations ['608a02fc-4be1-4c2a-8be3-7ddbf45eb28e', '7b1c2ec6-bfa2-4b61-bae9-8e9ec32a0043', '31351c26-5489-4f00-9cc7-7486c325d87e', '160e9f25-841a-497a-b24f-91029e0d1a71'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:50:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:34 devstack sudo[88623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:50:34 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:34 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0" returned: 0 in 2.175s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:34 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:50:34 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89711c0-cb9a-4cac-867a-aad1c5793c62]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:50:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:34 devstack sudo[88626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1
Jul 03 23:50:34 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:35 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1" returned: 0 in 1.235s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:35 devstack sudo[88636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0
Jul 03 23:50:35 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:35 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.977s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:35 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:50:36 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Deleted volume successfully.
Jul 03 23:50:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-463bd1ba-a73f-482b-acd2-7337eb3a602b tempest-ServerRescueNegativeTestJSON-666368097 None] Lock "cinder-870e207c-8b91-441a-890d-87036400f348-delete_volume" released by "delete_volume" :: held 5.934s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:37 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0" returned: 0 in 2.046s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:37 devstack sudo[88661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0
Jul 03 23:50:37 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:38 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1.98d94062-646c-4068-aeb4-d7b7d5fa30d0" returned: 0 in 1.005s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-98d94062-646c-4068-aeb4-d7b7d5fa30d0" released by "_delete_snapshot" :: held 6.694s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-24f73e53-83ed-4dd7-b9af-5ef82f454ce1" released by "delete_snapshot" :: held 6.776s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:38 devstack cinder-volume[86650]: WARNING cinder.quota [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1736291755 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1736291755, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:50:38 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] Created reservations ['fbf98afa-bc9b-4f94-9ae2-83fa93ad09ac', '75ed0982-cea8-4910-92ca-55c0b159eba2', '3af0d4b5-df87-492b-908b-d2367c6e9e67', '55e442c9-8bf1-4c38-88b3-0e0ba06529de'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:50:39 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7b4940ba-3862-4792-8ee7-d38a6e425296 tempest-GroupSnapshotsTest-1854254363 None] group_snapshot f5ad18bd-c702-4118-88d4-47c26e3b54f1: deleted successfully
Jul 03 23:50:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "cinder-quobyte-24f73e53-83ed-4dd7-b9af-5ef82f454ce1" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:50:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-24f73e53-83ed-4dd7-b9af-5ef82f454ce1" acquired by "delete_volume" :: waited 0.038s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:50:39 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[12291f3e-5632-4762-8fcf-5dd1e4f5c04d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:50:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:40 devstack sudo[88673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1
Jul 03 23:50:40 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:41 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1" returned: 0 in 1.470s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:41 devstack sudo[88678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1
Jul 03 23:50:41 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:42 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-24f73e53-83ed-4dd7-b9af-5ef82f454ce1" returned: 0 in 0.835s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-24f73e53-83ed-4dd7-b9af-5ef82f454ce1" released by "delete_volume" :: held 2.416s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:50:42 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] Created reservations ['92a88010-3679-4319-a798-ac4f2b282a29'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:50:42 devstack cinder-volume[86650]: WARNING cinder.db.api [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1736291755']
Jul 03 23:50:42 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] Created reservations ['3c4e765e-4a36-415f-b645-e50a5d9ef1c3', 'ca0ed56b-2dd7-4475-962f-448ba09c748f', 'be4efe4b-4f97-4086-93b9-d4dd4c89cb8e', 'f5c1caa7-5e69-4814-96aa-640a18e6ebe3'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:50:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:42 devstack sudo[88681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:50:42 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:43 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.833s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:43 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:50:43 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-21bdc084-93c7-4460-9faa-d320c46a3f56 tempest-GroupSnapshotsTest-1854254363 None] Delete group completed successfully.
Jul 03 23:50:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6c5b5912-3216-49b1-8d67-fb7e6045a510 tempest-GroupSnapshotsTest-1854254363 None] Group tempest-GroupSnapshotsTest-Group-712297405: creating
Jul 03 23:50:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6c5b5912-3216-49b1-8d67-fb7e6045a510 tempest-GroupSnapshotsTest-1854254363 None] Group tempest-GroupSnapshotsTest-Group-712297405: created successfully
Jul 03 23:50:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6c5b5912-3216-49b1-8d67-fb7e6045a510 tempest-GroupSnapshotsTest-1854254363 None] Create group completed successfully.
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Flow 'volume_create_manager' (48f17021-c459-401c-b68a-ada8e7f77d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f50c080-8ef8-4b0f-9774-a437fba8fdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f50c080-8ef8-4b0f-9774-a437fba8fdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-673717883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=03345356-8447-4e66-9bee-2032eb42aa85,host='devstack@QuobyteHD#QuobyteHD',id=40633f89-8b69-4e9e-b805-4b91273cc50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247ea0e31bd842aabd3ea9cfb523db33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:50:46Z,use_quota=True,user_id='c9f7786595534301a9dc5ebe60cfa882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29004ce3-2c34-4889-84cd-6577346bfb34),volume_type_id=29004ce3-2c34-4889-84cd-6577346bfb34)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1f3baf-e81c-42cd-9f71-2b9f74c04e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e1f3baf-e81c-42cd-9f71-2b9f74c04e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900634d9-2ecc-40e9-9bed-f2fb0649a05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900634d9-2ecc-40e9-9bed-f2fb0649a05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40633f89-8b69-4e9e-b805-4b91273cc50d', 'volume_name': 'volume-40633f89-8b69-4e9e-b805-4b91273cc50d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abd4578-8dab-48ef-998b-5248159cc485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abd4578-8dab-48ef-998b-5248159cc485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a881009-905d-4ba4-8f7f-da61202f8a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:46 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Volume 40633f89-8b69-4e9e-b805-4b91273cc50d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40633f89-8b69-4e9e-b805-4b91273cc50d', 'volume_size': 1}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=03345356-8447-4e66-9bee-2032eb42aa85,created_at=2026-07-03T21:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-673717883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=03345356-8447-4e66-9bee-2032eb42aa85,host='devstack@QuobyteHD#QuobyteHD',id=40633f89-8b69-4e9e-b805-4b91273cc50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247ea0e31bd842aabd3ea9cfb523db33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:50:46Z,use_quota=True,user_id='c9f7786595534301a9dc5ebe60cfa882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29004ce3-2c34-4889-84cd-6577346bfb34),volume_type_id=29004ce3-2c34-4889-84cd-6577346bfb34)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Creating volume 40633f89-8b69-4e9e-b805-4b91273cc50d {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:50:46 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:50:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:46 devstack sudo[88706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d 1073741824
Jul 03 23:50:46 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:47 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d 1073741824" returned: 0 in 1.099s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:47 devstack sudo[88712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d
Jul 03 23:50:47 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:48 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d" returned: 0 in 0.845s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:50:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.033s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a881009-905d-4ba4-8f7f-da61202f8a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40633f89-8b69-4e9e-b805-4b91273cc50d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3971a2-0e3b-4fe8-97ca-fca0da59c472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:48 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Volume volume-40633f89-8b69-4e9e-b805-4b91273cc50d (40633f89-8b69-4e9e-b805-4b91273cc50d): created successfully
Jul 03 23:50:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3971a2-0e3b-4fe8-97ca-fca0da59c472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Flow 'volume_create_manager' (48f17021-c459-401c-b68a-ada8e7f77d15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:50:48 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-56fb7117-7560-4c38-a95c-221ca361ba8d tempest-GroupSnapshotsTest-1854254363 None] Created volume successfully.
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Flow 'volume_create_manager' (1b0bfca3-7716-41dd-9fd8-c3fc0bef93a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1433ca-492f-4427-a59a-626e12a16b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a1433ca-492f-4427-a59a-626e12a16b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1162424089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=03345356-8447-4e66-9bee-2032eb42aa85,host='devstack@QuobyteHD#QuobyteHD',id=6a2a85bf-3231-435e-bad7-34760980ca42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247ea0e31bd842aabd3ea9cfb523db33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:50:50Z,use_quota=True,user_id='c9f7786595534301a9dc5ebe60cfa882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29004ce3-2c34-4889-84cd-6577346bfb34),volume_type_id=29004ce3-2c34-4889-84cd-6577346bfb34)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504297b4-4a6d-43fe-972d-b65861c62e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504297b4-4a6d-43fe-972d-b65861c62e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a27afc-6024-42ab-a3e6-0f9f6778dccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73a27afc-6024-42ab-a3e6-0f9f6778dccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2a85bf-3231-435e-bad7-34760980ca42', 'volume_name': 'volume-6a2a85bf-3231-435e-bad7-34760980ca42', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d55ded-0037-4f02-aa7f-1f7f8f25dd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19d55ded-0037-4f02-aa7f-1f7f8f25dd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce53b0d-e31c-41de-9133-d7a9fb5db84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:49 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Volume 6a2a85bf-3231-435e-bad7-34760980ca42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2a85bf-3231-435e-bad7-34760980ca42', 'volume_size': 1}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=03345356-8447-4e66-9bee-2032eb42aa85,created_at=2026-07-03T21:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1162424089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=03345356-8447-4e66-9bee-2032eb42aa85,host='devstack@QuobyteHD#QuobyteHD',id=6a2a85bf-3231-435e-bad7-34760980ca42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247ea0e31bd842aabd3ea9cfb523db33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:50:50Z,use_quota=True,user_id='c9f7786595534301a9dc5ebe60cfa882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(29004ce3-2c34-4889-84cd-6577346bfb34),volume_type_id=29004ce3-2c34-4889-84cd-6577346bfb34)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Creating volume 6a2a85bf-3231-435e-bad7-34760980ca42 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:50:49 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:50:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:49 devstack sudo[88717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42 1073741824
Jul 03 23:50:49 devstack sudo[88717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:50 devstack sudo[88717]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42 1073741824" returned: 0 in 1.161s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:50 devstack sudo[88723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42
Jul 03 23:50:50 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:51 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42" returned: 0 in 0.927s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:50:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:50:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ce53b0d-e31c-41de-9133-d7a9fb5db84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2a85bf-3231-435e-bad7-34760980ca42', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae02c5d2-e482-4049-82e3-ab60ca037481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:50:51 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Volume volume-6a2a85bf-3231-435e-bad7-34760980ca42 (6a2a85bf-3231-435e-bad7-34760980ca42): created successfully
Jul 03 23:50:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae02c5d2-e482-4049-82e3-ab60ca037481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:50:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Flow 'volume_create_manager' (1b0bfca3-7716-41dd-9fd8-c3fc0bef93a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:50:51 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-1846db10-4e14-464d-89f5-63075d466dfe tempest-GroupSnapshotsTest-1854254363 None] Created volume successfully.
Jul 03 23:50:53 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6ed2426a-d850-47f5-aba2-a3dc84d2deec tempest-GroupSnapshotsTest-1854254363 None] Update group completed successfully.
Jul 03 23:50:54 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-df921ed1-fc87-4486-a21a-cbd68253c45b tempest-GroupSnapshotsTest-1854254363 None] Update group completed successfully.
Jul 03 23:50:55 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c91801f0-8566-4a37-9832-60a89046df41 tempest-GroupSnapshotsTest-1854254363 None] Update group completed successfully.
Jul 03 23:50:57 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-85ae7edd-8007-47c6-be5e-a43a2e759732 tempest-GroupSnapshotsTest-1854254363 None] Update group completed successfully.
Jul 03 23:50:58 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] GroupSnapshot 485a4b1a-0ce0-4598-aa49-ae83c1232f18: creating.
Jul 03 23:50:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Group snapshot 485a4b1a-0ce0-4598-aa49-ae83c1232f18: creating. {{(pid=86650) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 23:50:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:50:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:50:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Creating offline snapshot 1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd of volume 6a2a85bf-3231-435e-bad7-34760980ca42 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:50:58 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c48fbb-ea01-44ee-bf86-8cdd063e524e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:50:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:59 devstack sudo[88736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42
Jul 03 23:50:59 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:50:59 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root
Jul 03 23:50:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42" returned: 0 in 0.981s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:50:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:50:59 devstack sudo[88742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd 1G
Jul 03 23:50:59 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:00 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd 1G" returned: 0 in 0.950s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a2a85bf-3231-435e-bad7-34760980ca42 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:00 devstack sudo[88748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a2a85bf-3231-435e-bad7-34760980ca42 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd
Jul 03 23:51:00 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:01 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a2a85bf-3231-435e-bad7-34760980ca42 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd" returned: 0 in 0.903s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:01 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:51:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:01 devstack sudo[88753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd
Jul 03 23:51:01 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:02 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd" returned: 0 in 0.800s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:02 devstack sudo[88756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.info
Jul 03 23:51:02 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:03 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:51:03 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Flow 'volume_create_manager' (1d110660-8ebf-4eb8-9859-572c1e09a6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ad1c9c-9589-47b8-8fd9-357eb9646671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.info" returned: 0 in 1.046s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:03 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:51:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ad1c9c-9589-47b8-8fd9-357eb9646671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1339633116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61005290-234f-4b62-bbd0-dee84846a565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d953c08e228b40ffa0af5a5207097fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:04Z,use_quota=True,user_id='4efd4a64f75944d5ae33d6b088554d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0bb1f56-6548-4e66-9620-75d078ea0e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:03 devstack sudo[88760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.info
Jul 03 23:51:03 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0bb1f56-6548-4e66-9620-75d078ea0e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88ec594-a216-43b2-bfcd-9c96428549ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a88ec594-a216-43b2-bfcd-9c96428549ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61005290-234f-4b62-bbd0-dee84846a565', 'volume_name': 'volume-61005290-234f-4b62-bbd0-dee84846a565', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e111c418-6a73-4aca-923b-d99f11c10ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e111c418-6a73-4aca-923b-d99f11c10ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c7e409-5180-45f2-b287-fc0f261b1792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:03 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Volume 61005290-234f-4b62-bbd0-dee84846a565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61005290-234f-4b62-bbd0-dee84846a565', 'volume_size': 1}
Jul 03 23:51:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:04 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.info" returned: 0 in 0.843s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.671s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Creating offline snapshot ec931359-e6d4-4400-a34a-fe1402fc9fbf of volume 40633f89-8b69-4e9e-b805-4b91273cc50d {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:51:04 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce78289-8c0e-47d2-99cc-a7b30e6fafea]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:51:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:04 devstack sudo[88764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d
Jul 03 23:51:04 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:05 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d" returned: 0 in 0.956s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:05 devstack sudo[88772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf 1G
Jul 03 23:51:05 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:06 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf 1G" returned: 0 in 1.076s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40633f89-8b69-4e9e-b805-4b91273cc50d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:06 devstack sudo[88781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40633f89-8b69-4e9e-b805-4b91273cc50d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf
Jul 03 23:51:06 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:07 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40633f89-8b69-4e9e-b805-4b91273cc50d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf" returned: 0 in 0.753s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:07 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:51:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:07 devstack sudo[88786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf
Jul 03 23:51:07 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:08 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf" returned: 0 in 0.744s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:08 devstack sudo[88789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.info
Jul 03 23:51:08 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:08 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.info" returned: 0 in 0.693s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:08 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:51:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:08 devstack sudo[88792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.info
Jul 03 23:51:08 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:09 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.info" returned: 0 in 0.737s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.086s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.895s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1339633116',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61005290-234f-4b62-bbd0-dee84846a565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d953c08e228b40ffa0af5a5207097fbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:04Z,use_quota=True,user_id='4efd4a64f75944d5ae33d6b088554d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:51:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Creating volume 61005290-234f-4b62-bbd0-dee84846a565 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:51:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:51:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:51:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:51:09 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:51:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-61005290-234f-4b62-bbd0-dee84846a565 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:09 devstack sudo[88795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-61005290-234f-4b62-bbd0-dee84846a565 1073741824
Jul 03 23:51:09 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:09 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-004ea3ce-7a6f-4900-a69c-7d2119fada28 tempest-GroupSnapshotsTest-1854254363 None] group_snapshot 485a4b1a-0ce0-4598-aa49-ae83c1232f18: created successfully
Jul 03 23:51:10 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] group_snapshot 485a4b1a-0ce0-4598-aa49-ae83c1232f18: deleting
Jul 03 23:51:10 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] group_snapshot 485a4b1a-0ce0-4598-aa49-ae83c1232f18: deleting {{(pid=86650) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 23:51:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "cinder-quobyte-6a2a85bf-3231-435e-bad7-34760980ca42" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:51:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-6a2a85bf-3231-435e-bad7-34760980ca42" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:51:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "cinder-quobyte-1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:51:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:51:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Deleting offline snapshot 1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd of volume 6a2a85bf-3231-435e-bad7-34760980ca42 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:51:10 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] snapshot_file for this snap is: volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:51:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-61005290-234f-4b62-bbd0-dee84846a565 1073741824" returned: 0 in 1.152s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:10 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec01ced0-a6ee-4cde-8ca4-77b92dd3f43e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:51:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-61005290-234f-4b62-bbd0-dee84846a565 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:10 devstack sudo[88803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-61005290-234f-4b62-bbd0-dee84846a565
Jul 03 23:51:10 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:10 devstack sudo[88802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd
Jul 03 23:51:10 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:11 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd" returned: 0 in 1.141s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a2a85bf-3231-435e-bad7-34760980ca42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:51:11 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb39014-8128-4caf-b8d8-b82bca092946]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:51:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:12 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-61005290-234f-4b62-bbd0-dee84846a565" returned: 0 in 1.275s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] <== create_volume: return (2503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:51:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.507s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c7e409-5180-45f2-b287-fc0f261b1792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61005290-234f-4b62-bbd0-dee84846a565', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:12 devstack sudo[88813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42
Jul 03 23:51:12 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88154b9-d5b0-4ac1-9cbf-54a8b593b828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:12 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Volume volume-61005290-234f-4b62-bbd0-dee84846a565 (61005290-234f-4b62-bbd0-dee84846a565): created successfully
Jul 03 23:51:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e88154b9-d5b0-4ac1-9cbf-54a8b593b828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Flow 'volume_create_manager' (1d110660-8ebf-4eb8-9859-572c1e09a6a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:12 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6fdc8891-60ea-4896-b907-b851f7093835 tempest-TaggedAttachmentsTest-659473798 None] Created volume successfully.
Jul 03 23:51:13 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42" returned: 0 in 1.352s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:13 devstack sudo[88839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd
Jul 03 23:51:13 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:51:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:51:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:51:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:14 devstack sudo[88845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:51:14 devstack sudo[88845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:14 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd" returned: 0 in 1.278s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:14 devstack sudo[88847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd
Jul 03 23:51:14 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:15 devstack sudo[88845]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.999s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:51:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:51:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 8 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:51:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:51:15 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42.1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd" returned: 0 in 0.907s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-1d8b7d40-f2ba-4fc8-8c14-b7fc1507affd" released by "_delete_snapshot" :: held 4.851s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:51:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-6a2a85bf-3231-435e-bad7-34760980ca42" released by "delete_snapshot" :: held 4.890s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:51:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "cinder-quobyte-40633f89-8b69-4e9e-b805-4b91273cc50d" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:51:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-40633f89-8b69-4e9e-b805-4b91273cc50d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:51:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "cinder-quobyte-ec931359-e6d4-4400-a34a-fe1402fc9fbf" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:51:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-ec931359-e6d4-4400-a34a-fe1402fc9fbf" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:51:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Deleting offline snapshot ec931359-e6d4-4400-a34a-fe1402fc9fbf of volume 40633f89-8b69-4e9e-b805-4b91273cc50d {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:51:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] snapshot_file for this snap is: volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:51:15 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[74be5909-86f0-4adc-90aa-391aa1f01627]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:51:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:15 devstack sudo[88853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf
Jul 03 23:51:15 devstack sudo[88853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:16 devstack sudo[88853]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf" returned: 0 in 0.891s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40633f89-8b69-4e9e-b805-4b91273cc50d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:51:16 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[30066932-0fd2-47c7-8286-154f544cc5f7]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:51:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:16 devstack sudo[88858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d
Jul 03 23:51:16 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:17 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d" returned: 0 in 0.904s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:17 devstack sudo[88864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf
Jul 03 23:51:17 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:18 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf" returned: 0 in 1.168s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:18 devstack sudo[88901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf
Jul 03 23:51:18 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:19 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d.ec931359-e6d4-4400-a34a-fe1402fc9fbf" returned: 0 in 1.133s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-ec931359-e6d4-4400-a34a-fe1402fc9fbf" released by "_delete_snapshot" :: held 4.270s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:51:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-40633f89-8b69-4e9e-b805-4b91273cc50d" released by "delete_snapshot" :: held 4.301s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:51:20 devstack cinder-volume[86650]: WARNING cinder.quota [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1186618430 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1186618430, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:51:20 devstack cinder-volume[86650]: WARNING cinder.quota [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1186618430 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1186618430, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:51:20 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Created reservations ['d25d07e4-544e-460d-9a5d-227e043e4b72', 'fcfc7143-3e57-433d-ad30-1e57c3146700', '41ffc67b-1732-4554-a138-3e6b5b4cbb3d', '15bcd32a-e3b7-49d4-ae6d-d40ed5c62be9'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:51:20 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] Created reservations ['ad5b27dd-ac28-49de-bd6d-7125574b71bb', 'f29df28c-c166-4418-8cef-9111e59f67c2', 'cddbb1e2-b965-4491-bb2f-7474366f83b0', '2de6dc30-84eb-4948-aecf-d34334522be0'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:51:20 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-42ab63bf-7c7b-4db1-a021-5826718d130a tempest-GroupSnapshotsTest-1854254363 None] group_snapshot 485a4b1a-0ce0-4598-aa49-ae83c1232f18: deleted successfully
Jul 03 23:51:21 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=71,cinder:UPDATE=65,cinder:INSERT=18,cinder:DELETE=3 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:51:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "cinder-quobyte-40633f89-8b69-4e9e-b805-4b91273cc50d" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:51:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-40633f89-8b69-4e9e-b805-4b91273cc50d" acquired by "delete_volume" :: waited 0.042s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:51:21 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9b473f-1df5-4dbc-899f-4291a73d1626]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:51:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:21 devstack sudo[88945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d
Jul 03 23:51:21 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:22 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d" returned: 0 in 1.391s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:22 devstack sudo[88955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d
Jul 03 23:51:22 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:23 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40633f89-8b69-4e9e-b805-4b91273cc50d" returned: 0 in 0.940s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:23 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-40633f89-8b69-4e9e-b805-4b91273cc50d" released by "delete_volume" :: held 2.463s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:51:23 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "cinder-quobyte-6a2a85bf-3231-435e-bad7-34760980ca42" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:51:23 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-6a2a85bf-3231-435e-bad7-34760980ca42" acquired by "delete_volume" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:51:23 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18e17c5-51c5-488b-bec8-9cf59c06e53f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:51:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:23 devstack sudo[88958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42
Jul 03 23:51:23 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:25 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42" returned: 0 in 1.204s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:25 devstack sudo[88963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42
Jul 03 23:51:25 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:26 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6a2a85bf-3231-435e-bad7-34760980ca42" returned: 0 in 1.182s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-6a2a85bf-3231-435e-bad7-34760980ca42" released by "delete_volume" :: held 2.517s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:51:26 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=69,cinder:SELECT=63,cinder:INSERT=13,cinder:DELETE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:51:26 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Created reservations ['b0205296-b941-49e0-bce9-059749fb661f'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:51:26 devstack cinder-volume[86650]: WARNING cinder.quota [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1186618430 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1186618430, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:51:26 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Created reservations ['a47ff1ed-9067-4e49-a346-39fcc3656495', '5bdb342f-6fe4-49cd-a2af-7d36a5ece0eb', 'e54badd2-d101-40ea-ad32-83294980fd19', 'b670278e-cc7b-4984-8131-a547fd06f997'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:51:26 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Created reservations ['142a7a0c-d967-4407-a267-a6a09b0e5f9d', '9256e53f-d3bd-40ab-8eda-24e184f8740b', '4a3bb215-172d-421b-918f-e5544f89d81a', 'c98d6e84-2f73-4965-91e4-703b826663f1'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:51:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:51:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:51:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:26 devstack sudo[88985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:51:26 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:27 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.033s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:27 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:51:27 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ecc84ab1-3f4a-4ebd-9cb6-48578cfae171 tempest-GroupSnapshotsTest-1854254363 None] Delete group completed successfully.
Jul 03 23:51:28 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bd92e60e-712e-4903-aaca-578290fa37f9 tempest-GroupSnapshotsTest-1854254363 None] Group tempest-GroupSnapshotsTest-Group-1486786680: creating
Jul 03 23:51:28 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bd92e60e-712e-4903-aaca-578290fa37f9 tempest-GroupSnapshotsTest-1854254363 None] Group tempest-GroupSnapshotsTest-Group-1486786680: created successfully
Jul 03 23:51:28 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bd92e60e-712e-4903-aaca-578290fa37f9 tempest-GroupSnapshotsTest-1854254363 None] Create group completed successfully.
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Flow 'volume_create_manager' (550f4caf-6707-4110-830a-1e352e012468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbe14a2-1fa7-4bbf-9849-07c2e6542015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bbe14a2-1fa7-4bbf-9849-07c2e6542015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-145987818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=22929db2-db4d-4f4d-b645-317c40816bf1,host='devstack@QuobyteHD#QuobyteHD',id=b8ca94f5-4ad6-49b5-805c-5221efa85424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247ea0e31bd842aabd3ea9cfb523db33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:31Z,use_quota=True,user_id='c9f7786595534301a9dc5ebe60cfa882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88686f47-01b8-4f5b-8022-2d53c0c9a8df),volume_type_id=88686f47-01b8-4f5b-8022-2d53c0c9a8df)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52434772-4013-46f8-800a-c053433c0cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52434772-4013-46f8-800a-c053433c0cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56cdf625-fb23-48fe-af8e-9d346a5fb136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56cdf625-fb23-48fe-af8e-9d346a5fb136) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8ca94f5-4ad6-49b5-805c-5221efa85424', 'volume_name': 'volume-b8ca94f5-4ad6-49b5-805c-5221efa85424', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e7f209-22b5-420a-ae58-67ea195022c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e7f209-22b5-420a-ae58-67ea195022c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968a8930-a88e-4c06-ac7e-df88ec332e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:30 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Volume b8ca94f5-4ad6-49b5-805c-5221efa85424: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8ca94f5-4ad6-49b5-805c-5221efa85424', 'volume_size': 1}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=22929db2-db4d-4f4d-b645-317c40816bf1,created_at=2026-07-03T21:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-145987818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=22929db2-db4d-4f4d-b645-317c40816bf1,host='devstack@QuobyteHD#QuobyteHD',id=b8ca94f5-4ad6-49b5-805c-5221efa85424,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='247ea0e31bd842aabd3ea9cfb523db33',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:31Z,use_quota=True,user_id='c9f7786595534301a9dc5ebe60cfa882',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88686f47-01b8-4f5b-8022-2d53c0c9a8df),volume_type_id=88686f47-01b8-4f5b-8022-2d53c0c9a8df)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Creating volume b8ca94f5-4ad6-49b5-805c-5221efa85424 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:51:30 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:51:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:30 devstack sudo[88999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424 1073741824
Jul 03 23:51:30 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:32 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424 1073741824" returned: 0 in 1.473s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:32 devstack sudo[89048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424
Jul 03 23:51:32 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:33 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424" returned: 0 in 0.816s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] <== create_volume: return (2384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:51:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.391s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (968a8930-a88e-4c06-ac7e-df88ec332e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8ca94f5-4ad6-49b5-805c-5221efa85424', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13a3b14-8aa9-4fdd-a69b-ac42aa900516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:33 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Volume volume-b8ca94f5-4ad6-49b5-805c-5221efa85424 (b8ca94f5-4ad6-49b5-805c-5221efa85424): created successfully
Jul 03 23:51:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13a3b14-8aa9-4fdd-a69b-ac42aa900516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Flow 'volume_create_manager' (550f4caf-6707-4110-830a-1e352e012468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:33 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-58e10944-561b-4983-b2b4-f5ec31cc1c93 tempest-GroupSnapshotsTest-1854254363 None] Created volume successfully.
Jul 03 23:51:34 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] GroupSnapshot 2801a74b-6661-43c6-b8fe-88a5721b0b07: creating.
Jul 03 23:51:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] Group snapshot 2801a74b-6661-43c6-b8fe-88a5721b0b07: creating. {{(pid=86650) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 23:51:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:34 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] Creating offline snapshot 1ecf6069-66c9-4f18-befa-ebbee0f2394f of volume b8ca94f5-4ad6-49b5-805c-5221efa85424 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:51:34 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[112d2090-3462-42a7-a78f-29107feecb3d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:51:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:34 devstack sudo[89099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424
Jul 03 23:51:34 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:35 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424" returned: 0 in 1.210s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:36 devstack sudo[89143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f 1G
Jul 03 23:51:36 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:37 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f 1G" returned: 0 in 1.638s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8ca94f5-4ad6-49b5-805c-5221efa85424 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:37 devstack sudo[89170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8ca94f5-4ad6-49b5-805c-5221efa85424 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f
Jul 03 23:51:37 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:38 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b8ca94f5-4ad6-49b5-805c-5221efa85424 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f" returned: 0 in 0.816s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:38 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:51:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:38 devstack sudo[89177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f
Jul 03 23:51:38 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:39 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f" returned: 0 in 0.731s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:39 devstack sudo[89180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.info
Jul 03 23:51:39 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:40 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.info" returned: 0 in 0.849s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:40 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:51:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:40 devstack sudo[89185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.info
Jul 03 23:51:40 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:40 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.info" returned: 0 in 0.712s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.075s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:40 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-744dcdeb-a31e-47e2-a9a9-4586377f49b2 tempest-GroupSnapshotsTest-1854254363 None] group_snapshot 2801a74b-6661-43c6-b8fe-88a5721b0b07: created successfully
Jul 03 23:51:41 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] group_snapshot 2801a74b-6661-43c6-b8fe-88a5721b0b07: deleting
Jul 03 23:51:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] group_snapshot 2801a74b-6661-43c6-b8fe-88a5721b0b07: deleting {{(pid=86650) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 23:51:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "cinder-quobyte-b8ca94f5-4ad6-49b5-805c-5221efa85424" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:51:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-b8ca94f5-4ad6-49b5-805c-5221efa85424" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:51:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "cinder-quobyte-1ecf6069-66c9-4f18-befa-ebbee0f2394f" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:51:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-1ecf6069-66c9-4f18-befa-ebbee0f2394f" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:51:41 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] Deleting offline snapshot 1ecf6069-66c9-4f18-befa-ebbee0f2394f of volume b8ca94f5-4ad6-49b5-805c-5221efa85424 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:51:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] snapshot_file for this snap is: volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:51:42 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ac70e5-bcfe-4bd1-b23b-7f01ff668f7d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:51:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:42 devstack sudo[89226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f
Jul 03 23:51:42 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:43 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f" returned: 0 in 1.137s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b8ca94f5-4ad6-49b5-805c-5221efa85424(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:51:43 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a30b2f-44fc-4d1e-9cc4-7b2726f9a844]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:51:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:43 devstack sudo[89265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424
Jul 03 23:51:43 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:44 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424" returned: 0 in 0.973s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:44 devstack sudo[89273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f
Jul 03 23:51:44 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:45 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f" returned: 0 in 0.880s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:45 devstack sudo[89278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f
Jul 03 23:51:45 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:45 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424.1ecf6069-66c9-4f18-befa-ebbee0f2394f" returned: 0 in 0.684s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-1ecf6069-66c9-4f18-befa-ebbee0f2394f" released by "_delete_snapshot" :: held 3.881s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:51:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-b8ca94f5-4ad6-49b5-805c-5221efa85424" released by "delete_snapshot" :: held 3.936s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:51:45 devstack cinder-volume[86650]: WARNING cinder.quota [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-691684407 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-691684407, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:51:45 devstack cinder-volume[86650]: WARNING cinder.quota [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-691684407 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-691684407, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:51:45 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] Created reservations ['c374fd78-58b1-40d9-bc3b-733a6cb15309', '232c534d-4dbc-4369-9211-c64ef89a3a0e', 'f80b17f8-dac5-4eb9-9ab4-db25d226d64e', 'e9bd782d-4afb-49ca-8a10-812557055c60'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:51:46 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f4db536e-b949-4d80-816e-9942a839d655 tempest-GroupSnapshotsTest-1854254363 None] group_snapshot 2801a74b-6661-43c6-b8fe-88a5721b0b07: deleted successfully
Jul 03 23:51:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "cinder-quobyte-b8ca94f5-4ad6-49b5-805c-5221efa85424" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:51:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-b8ca94f5-4ad6-49b5-805c-5221efa85424" acquired by "delete_volume" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:51:46 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[436ab989-2131-4b02-8188-174e5b0625ec]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:51:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:47 devstack sudo[89282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424
Jul 03 23:51:47 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:48 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424" returned: 0 in 1.079s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:48 devstack sudo[89306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424
Jul 03 23:51:48 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:48 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b8ca94f5-4ad6-49b5-805c-5221efa85424" returned: 0 in 0.758s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] Lock "cinder-quobyte-b8ca94f5-4ad6-49b5-805c-5221efa85424" released by "delete_volume" :: held 1.942s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:51:48 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] Created reservations ['6fc5a500-1118-4c40-8285-47626afb81ea'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:51:48 devstack cinder-volume[86650]: WARNING cinder.quota [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-691684407 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-691684407, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:51:48 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] Created reservations ['8e7e0fc5-8635-43fb-a75a-6396b894dba5', 'c048ca8c-4a6a-4b24-a870-322c6f8b4ac1', '8cec7f76-d243-4614-a562-295b789d7dd6', '30096746-ac1a-4266-bc0a-215ef7cb8ee8'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:51:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:51:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:51:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:49 devstack sudo[89311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:51:49 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:49 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.788s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:49 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:51:49 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bf594a0e-4dcc-4a8b-b041-5a153f8a0686 tempest-GroupSnapshotsTest-1854254363 None] Delete group completed successfully.
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Flow 'volume_create_manager' (ad4a643f-8a52-4bdf-afb1-85530101ce8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b406159-e3a8-49a5-862e-38759e129dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b406159-e3a8-49a5-862e-38759e129dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-4961606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d62046-7edb-48d3-bf01-09590ad07d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6167dc8a2eb1412bba8b65e9f09b15cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:50Z,use_quota=True,user_id='c0dface092e14490ae0562df4269c4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a7a229-13fa-4731-8ef1-179b5d071fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a7a229-13fa-4731-8ef1-179b5d071fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b290971-2fca-4916-aaaa-72f85423556d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b290971-2fca-4916-aaaa-72f85423556d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60d62046-7edb-48d3-bf01-09590ad07d85', 'volume_name': 'volume-60d62046-7edb-48d3-bf01-09590ad07d85', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2911cdce-b22c-4635-b7af-addcf02a802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2911cdce-b22c-4635-b7af-addcf02a802f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f68d00-b707-43eb-a840-338948456ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:50 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Volume 60d62046-7edb-48d3-bf01-09590ad07d85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60d62046-7edb-48d3-bf01-09590ad07d85', 'volume_size': 1}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-4961606',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60d62046-7edb-48d3-bf01-09590ad07d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6167dc8a2eb1412bba8b65e9f09b15cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:50Z,use_quota=True,user_id='c0dface092e14490ae0562df4269c4c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Creating volume 60d62046-7edb-48d3-bf01-09590ad07d85 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:51:50 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:51:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:50 devstack sudo[89314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85 1073741824
Jul 03 23:51:50 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:51 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85 1073741824" returned: 0 in 1.255s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:51 devstack sudo[89319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85
Jul 03 23:51:51 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:51:52 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root
Jul 03 23:51:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85" returned: 0 in 0.917s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:51:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] <== create_volume: return (2246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:51:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.250s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8f68d00-b707-43eb-a840-338948456ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60d62046-7edb-48d3-bf01-09590ad07d85', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e486171-c92e-436e-9687-d6d2955d9906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:52 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Volume volume-60d62046-7edb-48d3-bf01-09590ad07d85 (60d62046-7edb-48d3-bf01-09590ad07d85): created successfully
Jul 03 23:51:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e486171-c92e-436e-9687-d6d2955d9906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Flow 'volume_create_manager' (ad4a643f-8a52-4bdf-afb1-85530101ce8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:52 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-af02cd83-8355-484d-9be6-b6fa72df08e3 tempest-ServerActionsTestOtherA-1861267644 None] Created volume successfully.
Jul 03 23:51:55 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9071d855-0957-4dbf-98c3-44391b55194a tempest-GroupsTest-871144387 None] Group tempest-Group1-1793361227: creating
Jul 03 23:51:55 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9071d855-0957-4dbf-98c3-44391b55194a tempest-GroupsTest-871144387 None] Group tempest-Group1-1793361227: created successfully
Jul 03 23:51:55 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9071d855-0957-4dbf-98c3-44391b55194a tempest-GroupsTest-871144387 None] Create group completed successfully.
Jul 03 23:51:57 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-274a4562-6351-46cc-a259-c96fe984f98a tempest-GroupsTest-871144387 None] Group tempest-Group2-1404513107: creating
Jul 03 23:51:57 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-274a4562-6351-46cc-a259-c96fe984f98a tempest-GroupsTest-871144387 None] Group tempest-Group2-1404513107: created successfully
Jul 03 23:51:57 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-274a4562-6351-46cc-a259-c96fe984f98a tempest-GroupsTest-871144387 None] Create group completed successfully.
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Flow 'volume_create_manager' (1f127da0-0f4f-46c1-af50-4e6f549650f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9308b085-3641-4f7b-8416-b75a5fbe7930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9308b085-3641-4f7b-8416-b75a5fbe7930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1232302051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78faa3ac-2f91-4624-a72c-ffec00f2d0d6,host='devstack@QuobyteHD#QuobyteHD',id=531ab6a2-f7eb-4f00-8b68-942d0e9ba42d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a6a2fd67504647b6e9ac05fc5d3b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:59Z,use_quota=True,user_id='49f877783964421f9f57c9aba5a967d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8e23ae7-ae59-4348-84c7-06479898d8a4),volume_type_id=f8e23ae7-ae59-4348-84c7-06479898d8a4)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57cd4bf-95d3-4e60-80d1-d69425b78b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57cd4bf-95d3-4e60-80d1-d69425b78b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136d59d0-6118-4f28-be65-3ce33a767898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136d59d0-6118-4f28-be65-3ce33a767898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '531ab6a2-f7eb-4f00-8b68-942d0e9ba42d', 'volume_name': 'volume-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007508c8-dc3b-4c03-8d0a-8441d048abe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (007508c8-dc3b-4c03-8d0a-8441d048abe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b60dcfe-17c0-40e9-90e0-f1fbbcda730a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:51:58 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Volume 531ab6a2-f7eb-4f00-8b68-942d0e9ba42d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d', 'volume_size': 1}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=78faa3ac-2f91-4624-a72c-ffec00f2d0d6,created_at=2026-07-03T21:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1232302051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=78faa3ac-2f91-4624-a72c-ffec00f2d0d6,host='devstack@QuobyteHD#QuobyteHD',id=531ab6a2-f7eb-4f00-8b68-942d0e9ba42d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a6a2fd67504647b6e9ac05fc5d3b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:51:59Z,use_quota=True,user_id='49f877783964421f9f57c9aba5a967d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8e23ae7-ae59-4348-84c7-06479898d8a4),volume_type_id=f8e23ae7-ae59-4348-84c7-06479898d8a4)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Creating volume 531ab6a2-f7eb-4f00-8b68-942d0e9ba42d {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:51:58 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:51:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:51:59 devstack sudo[89353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d 1073741824
Jul 03 23:51:59 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:00 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d 1073741824" returned: 0 in 1.100s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:00 devstack sudo[89364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d
Jul 03 23:52:00 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:00 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d" returned: 0 in 0.859s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:52:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.014s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b60dcfe-17c0-40e9-90e0-f1fbbcda730a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9bb240-024c-4c2b-a0e1-1d396930e5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:01 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Volume volume-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d (531ab6a2-f7eb-4f00-8b68-942d0e9ba42d): created successfully
Jul 03 23:52:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab9bb240-024c-4c2b-a0e1-1d396930e5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Flow 'volume_create_manager' (1f127da0-0f4f-46c1-af50-4e6f549650f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:52:01 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-2c053e12-b5aa-431b-b61f-aeec2078a58b tempest-GroupsTest-871144387 None] Created volume successfully.
Jul 03 23:52:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Acquiring lock "cinder-quobyte-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:52:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Lock "cinder-quobyte-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d" acquired by "delete_volume" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:52:01 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc97621a-b9df-4cd8-8d64-def318994a59]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:02 devstack sudo[89384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d
Jul 03 23:52:02 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:02 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d" returned: 0 in 0.850s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:02 devstack sudo[89390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d
Jul 03 23:52:02 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:03 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d" returned: 0 in 0.703s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Lock "cinder-quobyte-531ab6a2-f7eb-4f00-8b68-942d0e9ba42d" released by "delete_volume" :: held 1.597s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:52:03 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Created reservations ['06bc49c2-f086-42a5-93fc-715943cd19a2'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:52:03 devstack cinder-volume[86650]: WARNING cinder.quota [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1625416451 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1625416451, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:52:03 devstack cinder-volume[86650]: WARNING cinder.quota [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1625416451 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1625416451, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:52:03 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Created reservations ['318b9d93-1bd0-4436-8fe7-84cba176aec2', '12c87cbc-519d-4b3c-9bd3-e6c98d495781', '0c9c0502-e7d9-48dd-83ea-ae86e2d712c6', 'e429d53e-e26f-4465-95d2-c9944a01fe97'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:52:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:03 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:03 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:03 devstack sudo[89394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:52:03 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:04 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-7a3248a3-5586-42e4-b44c-b62ffd70875c tempest-GroupsTest-871144387 None] Created reservations ['1cc80cfa-c106-42b2-b0e9-b86b51d91d5a'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:52:04 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.887s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:04 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:52:04 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-834c8573-3261-48dc-bf92-74d9c8916e0d tempest-GroupsTest-871144387 None] Delete group completed successfully.
Jul 03 23:52:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7a3248a3-5586-42e4-b44c-b62ffd70875c tempest-GroupsTest-871144387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7a3248a3-5586-42e4-b44c-b62ffd70875c tempest-GroupsTest-871144387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7a3248a3-5586-42e4-b44c-b62ffd70875c tempest-GroupsTest-871144387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7a3248a3-5586-42e4-b44c-b62ffd70875c tempest-GroupsTest-871144387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7a3248a3-5586-42e4-b44c-b62ffd70875c tempest-GroupsTest-871144387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a3248a3-5586-42e4-b44c-b62ffd70875c tempest-GroupsTest-871144387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:04 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:52:04 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:05 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a3248a3-5586-42e4-b44c-b62ffd70875c tempest-GroupsTest-871144387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.773s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:05 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-7a3248a3-5586-42e4-b44c-b62ffd70875c tempest-GroupsTest-871144387 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:52:05 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7a3248a3-5586-42e4-b44c-b62ffd70875c tempest-GroupsTest-871144387 None] Delete group completed successfully.
Jul 03 23:52:06 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-b2ccebe0-d146-4632-899f-c8ea1303eda8 tempest-GroupsTest-871144387 None] Group tempest-GroupsTest-Group-1944245057: creating
Jul 03 23:52:06 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-b2ccebe0-d146-4632-899f-c8ea1303eda8 tempest-GroupsTest-871144387 None] Group tempest-GroupsTest-Group-1944245057: created successfully
Jul 03 23:52:06 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-b2ccebe0-d146-4632-899f-c8ea1303eda8 tempest-GroupsTest-871144387 None] Create group completed successfully.
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Flow 'volume_create_manager' (7fab07be-1366-4202-b24e-aad510940641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6086503-fa36-4517-84a0-58ee3a0fafd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6086503-fa36-4517-84a0-58ee3a0fafd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-78937481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df091f60-d5a6-45d7-8475-41a0252bf0d9,host='devstack@QuobyteHD#QuobyteHD',id=887c6df6-8eec-41bf-9687-d52e02bc6c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a6a2fd67504647b6e9ac05fc5d3b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:52:08Z,use_quota=True,user_id='49f877783964421f9f57c9aba5a967d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e72eb2b-6d7d-4390-a6f3-77ace7aa85d9),volume_type_id=2e72eb2b-6d7d-4390-a6f3-77ace7aa85d9)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12a1543-d4be-4507-b94f-e55ece6a62e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e12a1543-d4be-4507-b94f-e55ece6a62e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01b7440-b05a-49b9-ae6a-1207ab544690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c01b7440-b05a-49b9-ae6a-1207ab544690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '887c6df6-8eec-41bf-9687-d52e02bc6c18', 'volume_name': 'volume-887c6df6-8eec-41bf-9687-d52e02bc6c18', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170e1ddc-17cc-4319-b772-16735319124c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170e1ddc-17cc-4319-b772-16735319124c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025382ed-4aeb-4f61-b0cd-995c469c0a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:08 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Volume 887c6df6-8eec-41bf-9687-d52e02bc6c18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-887c6df6-8eec-41bf-9687-d52e02bc6c18', 'volume_size': 1}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=df091f60-d5a6-45d7-8475-41a0252bf0d9,created_at=2026-07-03T21:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-78937481',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df091f60-d5a6-45d7-8475-41a0252bf0d9,host='devstack@QuobyteHD#QuobyteHD',id=887c6df6-8eec-41bf-9687-d52e02bc6c18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a6a2fd67504647b6e9ac05fc5d3b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:52:08Z,use_quota=True,user_id='49f877783964421f9f57c9aba5a967d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e72eb2b-6d7d-4390-a6f3-77ace7aa85d9),volume_type_id=2e72eb2b-6d7d-4390-a6f3-77ace7aa85d9)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Creating volume 887c6df6-8eec-41bf-9687-d52e02bc6c18 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:52:08 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:52:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-887c6df6-8eec-41bf-9687-d52e02bc6c18 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:09 devstack sudo[89506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-887c6df6-8eec-41bf-9687-d52e02bc6c18 1073741824
Jul 03 23:52:09 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:09 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:52:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Flow 'volume_create_manager' (33edad14-ca7c-4895-bca4-42e34171d1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:52:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805d0e55-6294-4eb5-bde8-77b23b2fe7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805d0e55-6294-4eb5-bde8-77b23b2fe7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-123119922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f03f4f-a817-42f5-8c42-219c31fd174b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f7420cf7444f0ebf8776f635192182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:52:09Z,use_quota=True,user_id='742dfd6c566d4e50a3626e01e3212151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17d9f30-d73e-4d31-89e9-e1d9b5c8a3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c17d9f30-d73e-4d31-89e9-e1d9b5c8a3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d078e2d-7529-405c-84d6-9b29bdab27de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d078e2d-7529-405c-84d6-9b29bdab27de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f03f4f-a817-42f5-8c42-219c31fd174b', 'volume_name': 'volume-d8f03f4f-a817-42f5-8c42-219c31fd174b', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d0fb4f-ece2-429d-af8e-40d6cd7b08d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d0fb4f-ece2-429d-af8e-40d6cd7b08d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dfc7fd-f81a-4b74-b15d-1669eb8073ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:09 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Volume d8f03f4f-a817-42f5-8c42-219c31fd174b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f03f4f-a817-42f5-8c42-219c31fd174b', 'volume_size': 1}
Jul 03 23:52:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:10 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-887c6df6-8eec-41bf-9687-d52e02bc6c18 1073741824" returned: 0 in 1.553s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-887c6df6-8eec-41bf-9687-d52e02bc6c18 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:10 devstack sudo[89542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-887c6df6-8eec-41bf-9687-d52e02bc6c18
Jul 03 23:52:10 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:11 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-887c6df6-8eec-41bf-9687-d52e02bc6c18" returned: 0 in 0.717s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] <== create_volume: return (2370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.395s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.701s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:52:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-123119922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f03f4f-a817-42f5-8c42-219c31fd174b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f7420cf7444f0ebf8776f635192182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:52:09Z,use_quota=True,user_id='742dfd6c566d4e50a3626e01e3212151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Creating volume d8f03f4f-a817-42f5-8c42-219c31fd174b {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:52:11 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d8f03f4f-a817-42f5-8c42-219c31fd174b 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (025382ed-4aeb-4f61-b0cd-995c469c0a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-887c6df6-8eec-41bf-9687-d52e02bc6c18', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41730c02-b76e-4414-b705-dab97a220aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:11 devstack sudo[89547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d8f03f4f-a817-42f5-8c42-219c31fd174b 1073741824
Jul 03 23:52:11 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:11 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Volume volume-887c6df6-8eec-41bf-9687-d52e02bc6c18 (887c6df6-8eec-41bf-9687-d52e02bc6c18): created successfully
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41730c02-b76e-4414-b705-dab97a220aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Flow 'volume_create_manager' (7fab07be-1366-4202-b24e-aad510940641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:52:11 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-632b2867-5670-42d0-9ebc-7f0e0ec53eab tempest-GroupsTest-871144387 None] Created volume successfully.
Jul 03 23:52:12 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d8f03f4f-a817-42f5-8c42-219c31fd174b 1073741824" returned: 0 in 1.089s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d8f03f4f-a817-42f5-8c42-219c31fd174b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:12 devstack sudo[89559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d8f03f4f-a817-42f5-8c42-219c31fd174b
Jul 03 23:52:12 devstack sudo[89559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:13 devstack sudo[89559]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d8f03f4f-a817-42f5-8c42-219c31fd174b" returned: 0 in 0.802s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dfc7fd-f81a-4b74-b15d-1669eb8073ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f03f4f-a817-42f5-8c42-219c31fd174b', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0680825f-820b-4073-8a3a-f1eaf10e33cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:13 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Volume volume-d8f03f4f-a817-42f5-8c42-219c31fd174b (d8f03f4f-a817-42f5-8c42-219c31fd174b): created successfully
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0680825f-820b-4073-8a3a-f1eaf10e33cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Flow 'volume_create_manager' (33edad14-ca7c-4895-bca4-42e34171d1db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Flow 'volume_create_manager' (bd754b96-ad90-4066-9dba-02636253bd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af2bc48-a82c-4465-bfff-3dbb3c741777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:13 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-2f935d10-53f9-4ed4-bfd9-87eede47d733 tempest-AttachVolumeTestJSON-383063172 None] Created volume successfully.
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af2bc48-a82c-4465-bfff-3dbb3c741777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2071054257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df091f60-d5a6-45d7-8475-41a0252bf0d9,host='devstack@QuobyteHD#QuobyteHD',id=fd3d431d-73a4-431d-ab75-f741caec471a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a6a2fd67504647b6e9ac05fc5d3b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:52:13Z,use_quota=True,user_id='49f877783964421f9f57c9aba5a967d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e72eb2b-6d7d-4390-a6f3-77ace7aa85d9),volume_type_id=2e72eb2b-6d7d-4390-a6f3-77ace7aa85d9)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b323bd-df29-48a5-a2b0-18b19d984425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86b323bd-df29-48a5-a2b0-18b19d984425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd328c67-36d2-43ef-b968-a0a850b651e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd328c67-36d2-43ef-b968-a0a850b651e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd3d431d-73a4-431d-ab75-f741caec471a', 'volume_name': 'volume-fd3d431d-73a4-431d-ab75-f741caec471a', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bc7219-328a-4586-9fbd-0fe5821265ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bc7219-328a-4586-9fbd-0fe5821265ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e27ec4-5c06-4294-82a0-71cfe34ec76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:13 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Volume fd3d431d-73a4-431d-ab75-f741caec471a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd3d431d-73a4-431d-ab75-f741caec471a', 'volume_size': 1}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=df091f60-d5a6-45d7-8475-41a0252bf0d9,created_at=2026-07-03T21:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2071054257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=df091f60-d5a6-45d7-8475-41a0252bf0d9,host='devstack@QuobyteHD#QuobyteHD',id=fd3d431d-73a4-431d-ab75-f741caec471a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64a6a2fd67504647b6e9ac05fc5d3b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:52:13Z,use_quota=True,user_id='49f877783964421f9f57c9aba5a967d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e72eb2b-6d7d-4390-a6f3-77ace7aa85d9),volume_type_id=2e72eb2b-6d7d-4390-a6f3-77ace7aa85d9)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Creating volume fd3d431d-73a4-431d-ab75-f741caec471a {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:52:13 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:52:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd3d431d-73a4-431d-ab75-f741caec471a 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:13 devstack sudo[89564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd3d431d-73a4-431d-ab75-f741caec471a 1073741824
Jul 03 23:52:13 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:52:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:14 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd3d431d-73a4-431d-ab75-f741caec471a 1073741824" returned: 0 in 0.983s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:14 devstack sudo[89573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:52:14 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd3d431d-73a4-431d-ab75-f741caec471a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:14 devstack sudo[89575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd3d431d-73a4-431d-ab75-f741caec471a
Jul 03 23:52:14 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:15 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.820s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:52:15 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd3d431d-73a4-431d-ab75-f741caec471a" returned: 0 in 0.802s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:52:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17e27ec4-5c06-4294-82a0-71cfe34ec76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd3d431d-73a4-431d-ab75-f741caec471a', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651e0725-7d37-4594-a5ca-29fd3866f382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:15 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Volume volume-fd3d431d-73a4-431d-ab75-f741caec471a (fd3d431d-73a4-431d-ab75-f741caec471a): created successfully
Jul 03 23:52:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (651e0725-7d37-4594-a5ca-29fd3866f382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Flow 'volume_create_manager' (bd754b96-ad90-4066-9dba-02636253bd9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:52:15 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-10cca1c9-b657-46e1-b2d2-c610d3f37fde tempest-GroupsTest-871144387 None] Created volume successfully.
Jul 03 23:52:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-3fa0d18a-868f-4ddf-9cce-edf46f900647 req-288a5747-b2a0-420a-a65e-7f3087efbf37 tempest-TaggedAttachmentsTest-659473798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-3fa0d18a-868f-4ddf-9cce-edf46f900647 req-288a5747-b2a0-420a-a65e-7f3087efbf37 tempest-TaggedAttachmentsTest-659473798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:15 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab8409f-bcb9-4139-a7ff-0b302bcd984e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-3fa0d18a-868f-4ddf-9cce-edf46f900647 req-288a5747-b2a0-420a-a65e-7f3087efbf37 tempest-TaggedAttachmentsTest-659473798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-61005290-234f-4b62-bbd0-dee84846a565 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:15 devstack sudo[89588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-61005290-234f-4b62-bbd0-dee84846a565
Jul 03 23:52:15 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:16 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-951021c9-af0f-443d-9449-dfc279bb10a7 tempest-GroupsTest-871144387 None] Update group completed successfully.
Jul 03 23:52:16 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-3fa0d18a-868f-4ddf-9cce-edf46f900647 req-288a5747-b2a0-420a-a65e-7f3087efbf37 tempest-TaggedAttachmentsTest-659473798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-61005290-234f-4b62-bbd0-dee84846a565" returned: 0 in 0.809s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-3fa0d18a-868f-4ddf-9cce-edf46f900647 req-288a5747-b2a0-420a-a65e-7f3087efbf37 tempest-TaggedAttachmentsTest-659473798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.830s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-3fa0d18a-868f-4ddf-9cce-edf46f900647 req-288a5747-b2a0-420a-a65e-7f3087efbf37 tempest-TaggedAttachmentsTest-659473798 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-61005290-234f-4b62-bbd0-dee84846a565', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c11ecf3-7dfb-4afe-adef-269c08688117', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:52:16 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-3fa0d18a-868f-4ddf-9cce-edf46f900647 req-288a5747-b2a0-420a-a65e-7f3087efbf37 tempest-TaggedAttachmentsTest-659473798 None] attachment_update completed successfully.
Jul 03 23:52:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-fa030713-31f7-4c05-88a2-3aa6c80a5a9e req-a5dcac5d-5380-4c1d-a03f-9a28d8639770 tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-fa030713-31f7-4c05-88a2-3aa6c80a5a9e req-a5dcac5d-5380-4c1d-a03f-9a28d8639770 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:16 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3ae398-e340-4b5e-9f76-1efe19fdddce]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-fa030713-31f7-4c05-88a2-3aa6c80a5a9e req-a5dcac5d-5380-4c1d-a03f-9a28d8639770 tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d8f03f4f-a817-42f5-8c42-219c31fd174b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:16 devstack sudo[89649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d8f03f4f-a817-42f5-8c42-219c31fd174b
Jul 03 23:52:16 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:17 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-fa030713-31f7-4c05-88a2-3aa6c80a5a9e req-a5dcac5d-5380-4c1d-a03f-9a28d8639770 tempest-AttachVolumeTestJSON-383063172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d8f03f4f-a817-42f5-8c42-219c31fd174b" returned: 0 in 0.873s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-fa030713-31f7-4c05-88a2-3aa6c80a5a9e req-a5dcac5d-5380-4c1d-a03f-9a28d8639770 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.897s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-fa030713-31f7-4c05-88a2-3aa6c80a5a9e req-a5dcac5d-5380-4c1d-a03f-9a28d8639770 tempest-AttachVolumeTestJSON-383063172 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-d8f03f4f-a817-42f5-8c42-219c31fd174b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52a74308-6c0a-447c-8478-8e7b2c82d3b6', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:52:17 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-fa030713-31f7-4c05-88a2-3aa6c80a5a9e req-a5dcac5d-5380-4c1d-a03f-9a28d8639770 tempest-AttachVolumeTestJSON-383063172 None] attachment_update completed successfully.
Jul 03 23:52:17 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6fa7ab9d-671d-4396-a97c-a396fd410ed5 tempest-GroupsTest-871144387 None] Update group completed successfully.
Jul 03 23:52:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Acquiring lock "cinder-quobyte-887c6df6-8eec-41bf-9687-d52e02bc6c18" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:52:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Lock "cinder-quobyte-887c6df6-8eec-41bf-9687-d52e02bc6c18" acquired by "delete_volume" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:52:19 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe9c988-e2fc-4730-a812-4e593753285a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-887c6df6-8eec-41bf-9687-d52e02bc6c18 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:19 devstack sudo[89994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-887c6df6-8eec-41bf-9687-d52e02bc6c18
Jul 03 23:52:19 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:20 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-887c6df6-8eec-41bf-9687-d52e02bc6c18" returned: 0 in 0.836s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-887c6df6-8eec-41bf-9687-d52e02bc6c18 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:20 devstack sudo[90016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-887c6df6-8eec-41bf-9687-d52e02bc6c18
Jul 03 23:52:20 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:20 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-887c6df6-8eec-41bf-9687-d52e02bc6c18" returned: 0 in 0.676s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Lock "cinder-quobyte-887c6df6-8eec-41bf-9687-d52e02bc6c18" released by "delete_volume" :: held 1.572s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:52:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Acquiring lock "cinder-quobyte-fd3d431d-73a4-431d-ab75-f741caec471a" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:52:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Lock "cinder-quobyte-fd3d431d-73a4-431d-ab75-f741caec471a" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:52:20 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf5a0f1-247c-41c1-96dd-9f4b5defd165]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd3d431d-73a4-431d-ab75-f741caec471a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:21 devstack sudo[90023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd3d431d-73a4-431d-ab75-f741caec471a
Jul 03 23:52:21 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:21 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd3d431d-73a4-431d-ab75-f741caec471a" returned: 0 in 0.829s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd3d431d-73a4-431d-ab75-f741caec471a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:21 devstack sudo[90029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd3d431d-73a4-431d-ab75-f741caec471a
Jul 03 23:52:21 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:22 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd3d431d-73a4-431d-ab75-f741caec471a" returned: 0 in 0.650s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Lock "cinder-quobyte-fd3d431d-73a4-431d-ab75-f741caec471a" released by "delete_volume" :: held 1.524s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:52:22 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=86,cinder:UPDATE=88,cinder:INSERT=18,cinder:DELETE=2 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:52:22 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Created reservations ['4a4d33d1-eb6e-4005-9653-5bd41d743c57'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:52:22 devstack cinder-volume[86650]: WARNING cinder.quota [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-946236660 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-946236660, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:52:22 devstack cinder-volume[86650]: WARNING cinder.quota [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-946236660 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-946236660, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:52:22 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Created reservations ['9155d352-4b4f-48f0-ad69-422fb39e5b23', '169a8968-2b77-4559-b0a7-a3508b182daf', '604b19fc-66fd-4298-af0c-291075f33f7c', 'a5bac815-5613-4d97-a9d3-89420c376f2d'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:52:22 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-6626ac72-c7f8-476d-b38d-a1c474de61d9 req-95f2e1a3-d0d0-403c-8df9-0dfa2b8eb573 tempest-TaggedAttachmentsTest-659473798 None] Terminate volume connection completed successfully.
Jul 03 23:52:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-6626ac72-c7f8-476d-b38d-a1c474de61d9 req-95f2e1a3-d0d0-403c-8df9-0dfa2b8eb573 tempest-TaggedAttachmentsTest-659473798 None] Deleting attachment 8c11ecf3-7dfb-4afe-adef-269c08688117. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:52:22 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Created reservations ['9ba947b4-3e49-4d8d-9e79-3d01618cf4d6', 'e5157bcf-beaa-490c-a7af-bb077f8b6c92', '7c062f49-f5ee-4908-bf22-c780cd7793f7', '4fdaccfa-8299-45d1-8315-5a9ebcad341c'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:52:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:22 devstack sudo[90036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:52:22 devstack sudo[90036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:23 devstack sudo[90036]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.709s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:23 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:52:23 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-a7f99b2c-4729-4769-84fe-2338b1f73329 tempest-GroupsTest-871144387 None] Delete group completed successfully.
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Flow 'volume_create_manager' (d5b0e8dd-92be-4438-aaf4-e165076a45dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44265687-dd93-4484-9a56-19103910debd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=93,cinder:INSERT=17,cinder:UPDATE=89,cinder:DELETE=4 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44265687-dd93-4484-9a56-19103910debd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1038712984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853c3e8f-3361-49ce-9fd7-f4d50b1950fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5836bc6553c449818905baf4c666ccf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:52:29Z,use_quota=True,user_id='ac93d8426b10458aa95b04693dcb24ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea76e4c2-d8e1-443e-a423-7dbf32974e6b),volume_type_id=ea76e4c2-d8e1-443e-a423-7dbf32974e6b)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c8892b-912f-4e12-8a68-7be18bd3e151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64c8892b-912f-4e12-8a68-7be18bd3e151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e0995a-7719-4c93-87b1-e14d5beab8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6e0995a-7719-4c93-87b1-e14d5beab8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '853c3e8f-3361-49ce-9fd7-f4d50b1950fc', 'volume_name': 'volume-853c3e8f-3361-49ce-9fd7-f4d50b1950fc', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61836fe7-1758-430f-a2f1-bb34503f78c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61836fe7-1758-430f-a2f1-bb34503f78c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09672526-6800-4cd0-948d-7003e9fd1e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:29 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Volume 853c3e8f-3361-49ce-9fd7-f4d50b1950fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-853c3e8f-3361-49ce-9fd7-f4d50b1950fc', 'volume_size': 1}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:52:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1038712984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=853c3e8f-3361-49ce-9fd7-f4d50b1950fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5836bc6553c449818905baf4c666ccf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:52:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:52:29Z,use_quota=True,user_id='ac93d8426b10458aa95b04693dcb24ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea76e4c2-d8e1-443e-a423-7dbf32974e6b),volume_type_id=ea76e4c2-d8e1-443e-a423-7dbf32974e6b)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Creating volume 853c3e8f-3361-49ce-9fd7-f4d50b1950fc {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:52:29 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:52:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-853c3e8f-3361-49ce-9fd7-f4d50b1950fc 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:29 devstack sudo[90072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-853c3e8f-3361-49ce-9fd7-f4d50b1950fc 1073741824
Jul 03 23:52:29 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:30 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-853c3e8f-3361-49ce-9fd7-f4d50b1950fc 1073741824" returned: 0 in 1.022s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-853c3e8f-3361-49ce-9fd7-f4d50b1950fc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:30 devstack sudo[90120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-853c3e8f-3361-49ce-9fd7-f4d50b1950fc
Jul 03 23:52:30 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:31 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-853c3e8f-3361-49ce-9fd7-f4d50b1950fc" returned: 0 in 0.692s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:52:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09672526-6800-4cd0-948d-7003e9fd1e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-853c3e8f-3361-49ce-9fd7-f4d50b1950fc', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39271e8-42a6-478d-9408-b02e119daa4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:52:31 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Volume volume-853c3e8f-3361-49ce-9fd7-f4d50b1950fc (853c3e8f-3361-49ce-9fd7-f4d50b1950fc): created successfully
Jul 03 23:52:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f39271e8-42a6-478d-9408-b02e119daa4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:52:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Flow 'volume_create_manager' (d5b0e8dd-92be-4438-aaf4-e165076a45dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:52:31 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3b0a1ca0-7f42-4003-806d-e34db8b4b916 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Created volume successfully.
Jul 03 23:52:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c27f44a4-4121-406b-b4b1-7248832f7ce0 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c27f44a4-4121-406b-b4b1-7248832f7ce0 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c27f44a4-4121-406b-b4b1-7248832f7ce0 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c27f44a4-4121-406b-b4b1-7248832f7ce0 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c27f44a4-4121-406b-b4b1-7248832f7ce0 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c27f44a4-4121-406b-b4b1-7248832f7ce0 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:31 devstack sudo[90193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:52:31 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:32 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c27f44a4-4121-406b-b4b1-7248832f7ce0 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.647s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:32 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-c27f44a4-4121-406b-b4b1-7248832f7ce0 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:52:32 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c27f44a4-4121-406b-b4b1-7248832f7ce0 tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Retype volume completed successfully.
Jul 03 23:52:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Acquiring lock "cinder-853c3e8f-3361-49ce-9fd7-f4d50b1950fc-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:52:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Lock "cinder-853c3e8f-3361-49ce-9fd7-f4d50b1950fc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:52:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Acquiring lock "cinder-quobyte-853c3e8f-3361-49ce-9fd7-f4d50b1950fc" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:52:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Lock "cinder-quobyte-853c3e8f-3361-49ce-9fd7-f4d50b1950fc" acquired by "delete_volume" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:52:33 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2305dbba-a49a-4959-8f16-95499c1daa0d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-853c3e8f-3361-49ce-9fd7-f4d50b1950fc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:33 devstack sudo[90231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-853c3e8f-3361-49ce-9fd7-f4d50b1950fc
Jul 03 23:52:33 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:34 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-853c3e8f-3361-49ce-9fd7-f4d50b1950fc" returned: 0 in 1.471s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-853c3e8f-3361-49ce-9fd7-f4d50b1950fc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:34 devstack sudo[90623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-853c3e8f-3361-49ce-9fd7-f4d50b1950fc
Jul 03 23:52:34 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-7cfdec5c-7ab7-4268-a88c-ac485aebb075 req-ca7248b5-1d85-4421-81c9-4f4cdcabcdd1 tempest-ServerActionsTestOtherA-1861267644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-7cfdec5c-7ab7-4268-a88c-ac485aebb075 req-ca7248b5-1d85-4421-81c9-4f4cdcabcdd1 tempest-ServerActionsTestOtherA-1861267644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:35 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc0b8ef-e11e-4a6c-adf5-26fd2b34c222]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-7cfdec5c-7ab7-4268-a88c-ac485aebb075 req-ca7248b5-1d85-4421-81c9-4f4cdcabcdd1 tempest-ServerActionsTestOtherA-1861267644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:35 devstack sudo[90636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85
Jul 03 23:52:35 devstack sudo[90636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:35 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-853c3e8f-3361-49ce-9fd7-f4d50b1950fc" returned: 0 in 1.150s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Lock "cinder-quobyte-853c3e8f-3361-49ce-9fd7-f4d50b1950fc" released by "delete_volume" :: held 2.670s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:52:35 devstack cinder-volume[86650]: WARNING cinder.quota [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:52:35 devstack cinder-volume[86650]: WARNING cinder.quota [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:52:35 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Created reservations ['8cc6277b-edbc-4bee-89af-80f8d7a537ef', '6a938462-83e3-43a2-add6-68a41e525bc4', 'a2a1c4ad-7c46-4da7-afb0-57f5513c31df', 'd7ccd10c-e877-482d-8924-bac63df662ee'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:52:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:36 devstack sudo[90643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:52:36 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:36 devstack sudo[90636]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-7cfdec5c-7ab7-4268-a88c-ac485aebb075 req-ca7248b5-1d85-4421-81c9-4f4cdcabcdd1 tempest-ServerActionsTestOtherA-1861267644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85" returned: 0 in 1.048s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-7cfdec5c-7ab7-4268-a88c-ac485aebb075 req-ca7248b5-1d85-4421-81c9-4f4cdcabcdd1 tempest-ServerActionsTestOtherA-1861267644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.072s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-7cfdec5c-7ab7-4268-a88c-ac485aebb075 req-ca7248b5-1d85-4421-81c9-4f4cdcabcdd1 tempest-ServerActionsTestOtherA-1861267644 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-60d62046-7edb-48d3-bf01-09590ad07d85', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17e9b563-9898-4982-9429-c00e90103bee', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:52:36 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-7cfdec5c-7ab7-4268-a88c-ac485aebb075 req-ca7248b5-1d85-4421-81c9-4f4cdcabcdd1 tempest-ServerActionsTestOtherA-1861267644 None] attachment_update completed successfully.
Jul 03 23:52:37 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.983s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:37 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:52:37 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Deleted volume successfully.
Jul 03 23:52:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c603adf7-6091-42ad-a0a7-524a736127ab tempest-VolumeRetypeWithoutMigrationTest-1343793989 None] Lock "cinder-853c3e8f-3361-49ce-9fd7-f4d50b1950fc-delete_volume" released by "delete_volume" :: held 3.992s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:52:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Acquiring lock "cinder-61005290-234f-4b62-bbd0-dee84846a565-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:52:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Lock "cinder-61005290-234f-4b62-bbd0-dee84846a565-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:52:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Acquiring lock "cinder-quobyte-61005290-234f-4b62-bbd0-dee84846a565" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:52:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Lock "cinder-quobyte-61005290-234f-4b62-bbd0-dee84846a565" acquired by "delete_volume" :: waited 0.032s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:52:42 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[54206fb0-2988-4bb5-b415-a7813ab44b35]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-61005290-234f-4b62-bbd0-dee84846a565 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:42 devstack sudo[90694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-61005290-234f-4b62-bbd0-dee84846a565
Jul 03 23:52:42 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:44 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-61005290-234f-4b62-bbd0-dee84846a565" returned: 0 in 1.434s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-61005290-234f-4b62-bbd0-dee84846a565 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:44 devstack sudo[90703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-61005290-234f-4b62-bbd0-dee84846a565
Jul 03 23:52:44 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:44 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-61005290-234f-4b62-bbd0-dee84846a565" returned: 0 in 0.731s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Lock "cinder-quobyte-61005290-234f-4b62-bbd0-dee84846a565" released by "delete_volume" :: held 2.235s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:52:44 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Created reservations ['4779a96a-992f-4659-b00b-6d8c911de4ff', '2b992b8e-4038-4e32-92c5-b5eacb2cb93e', 'ecd6ff32-2d8d-424a-b6b8-55726393b04f', '7449c2b4-e788-4ce0-91d1-a44445a8db27'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:52:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:52:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:52:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:45 devstack sudo[90706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:52:45 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:45 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-fd0b94df-b285-4894-b72b-a15d5b4a1a9a req-21cdb9a7-7309-45ca-bd23-5516f1b99a89 tempest-ServerActionsTestOtherA-1861267644 None] Terminate volume connection completed successfully.
Jul 03 23:52:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-fd0b94df-b285-4894-b72b-a15d5b4a1a9a req-21cdb9a7-7309-45ca-bd23-5516f1b99a89 tempest-ServerActionsTestOtherA-1861267644 None] Deleting attachment 17e9b563-9898-4982-9429-c00e90103bee. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:52:45 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.904s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:45 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:52:45 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Deleted volume successfully.
Jul 03 23:52:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b5279ba-4f39-4b2b-b85d-e9a957b11451 tempest-TaggedAttachmentsTest-659473798 None] Lock "cinder-61005290-234f-4b62-bbd0-dee84846a565-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:52:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-fd0b94df-b285-4894-b72b-a15d5b4a1a9a req-d6514852-ea64-4744-aa1b-372fe4468795 tempest-ServerActionsTestOtherA-1861267644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:52:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-fd0b94df-b285-4894-b72b-a15d5b4a1a9a req-d6514852-ea64-4744-aa1b-372fe4468795 tempest-ServerActionsTestOtherA-1861267644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:52:48 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb944fa8-a5dc-4f94-9ff5-f00362849b32]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:52:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-fd0b94df-b285-4894-b72b-a15d5b4a1a9a req-d6514852-ea64-4744-aa1b-372fe4468795 tempest-ServerActionsTestOtherA-1861267644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:52:48 devstack sudo[90754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85
Jul 03 23:52:48 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:52:49 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root
Jul 03 23:52:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-fd0b94df-b285-4894-b72b-a15d5b4a1a9a req-d6514852-ea64-4744-aa1b-372fe4468795 tempest-ServerActionsTestOtherA-1861267644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85" returned: 0 in 1.194s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:52:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-fd0b94df-b285-4894-b72b-a15d5b4a1a9a req-d6514852-ea64-4744-aa1b-372fe4468795 tempest-ServerActionsTestOtherA-1861267644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.229s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:52:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-fd0b94df-b285-4894-b72b-a15d5b4a1a9a req-d6514852-ea64-4744-aa1b-372fe4468795 tempest-ServerActionsTestOtherA-1861267644 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-60d62046-7edb-48d3-bf01-09590ad07d85', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d174a98-a921-4609-b0ef-03c6e6d25595', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:52:50 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-fd0b94df-b285-4894-b72b-a15d5b4a1a9a req-d6514852-ea64-4744-aa1b-372fe4468795 tempest-ServerActionsTestOtherA-1861267644 None] attachment_update completed successfully.
Jul 03 23:53:00 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=29,cinder:SELECT=28,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:53:00 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=43,cinder:INSERT=9,cinder:UPDATE=39,cinder:DELETE=2 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:53:02 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-4ca3dc65-031e-4c4b-a7c1-84879ad9e7f7 req-5e8ae0f1-93c0-4504-bc6b-9d4f87f2868e tempest-AttachVolumeTestJSON-383063172 None] Terminate volume connection completed successfully.
Jul 03 23:53:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-4ca3dc65-031e-4c4b-a7c1-84879ad9e7f7 req-5e8ae0f1-93c0-4504-bc6b-9d4f87f2868e tempest-AttachVolumeTestJSON-383063172 None] Deleting attachment 52a74308-6c0a-447c-8478-8e7b2c82d3b6. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:53:12 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:53:12 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:53:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:53:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:14 devstack sudo[90933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:53:14 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:15 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.959s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:53:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:53:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 8 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:53:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:53:24 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-954760f1-9e4f-4fab-9544-70c68a33dbe3 req-36359060-f900-4ce0-934e-3313a10cf5b9 tempest-ServerActionsTestOtherA-1861267644 None] Terminate volume connection completed successfully.
Jul 03 23:53:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-954760f1-9e4f-4fab-9544-70c68a33dbe3 req-36359060-f900-4ce0-934e-3313a10cf5b9 tempest-ServerActionsTestOtherA-1861267644 None] Deleting attachment 8d174a98-a921-4609-b0ef-03c6e6d25595. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:53:34 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=2 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Flow 'volume_create_manager' (ca77b366-212d-495f-a972-2189c19c36af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea25d21c-759d-4275-968a-7ced9be631f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea25d21c-759d-4275-968a-7ced9be631f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-506374990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd6f1218-dafc-426c-9584-eb34853fb534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094aaff95d50448c99854c1d6913b79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:38Z,use_quota=True,user_id='0c2fc70688c248f1bcca0932ece0c133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ff31ce-66df-442d-90f8-50626ff05f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ff31ce-66df-442d-90f8-50626ff05f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cf88d5-5eeb-4b02-a4bd-d9d8a039ae74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9cf88d5-5eeb-4b02-a4bd-d9d8a039ae74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd6f1218-dafc-426c-9584-eb34853fb534', 'volume_name': 'volume-bd6f1218-dafc-426c-9584-eb34853fb534', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b556d5da-9701-48e5-9fa6-7858104f7fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b556d5da-9701-48e5-9fa6-7858104f7fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f74046a-0c4d-4510-a2c4-394601f7863e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:38 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Volume bd6f1218-dafc-426c-9584-eb34853fb534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd6f1218-dafc-426c-9584-eb34853fb534', 'volume_size': 1}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:53:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-506374990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd6f1218-dafc-426c-9584-eb34853fb534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094aaff95d50448c99854c1d6913b79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:53:38Z,use_quota=True,user_id='0c2fc70688c248f1bcca0932ece0c133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Creating volume bd6f1218-dafc-426c-9584-eb34853fb534 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:53:38 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bd6f1218-dafc-426c-9584-eb34853fb534 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Acquiring lock "cinder-60d62046-7edb-48d3-bf01-09590ad07d85-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:38 devstack sudo[91214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bd6f1218-dafc-426c-9584-eb34853fb534 1073741824
Jul 03 23:53:38 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Lock "cinder-60d62046-7edb-48d3-bf01-09590ad07d85-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Acquiring lock "cinder-quobyte-60d62046-7edb-48d3-bf01-09590ad07d85" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Lock "cinder-quobyte-60d62046-7edb-48d3-bf01-09590ad07d85" acquired by "delete_volume" :: waited 0.036s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:39 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[600068c2-48a2-4179-8b71-77041d356af4]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:53:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:39 devstack sudo[91216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85
Jul 03 23:53:39 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:40 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bd6f1218-dafc-426c-9584-eb34853fb534 1073741824" returned: 0 in 1.539s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bd6f1218-dafc-426c-9584-eb34853fb534 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:40 devstack sudo[91226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bd6f1218-dafc-426c-9584-eb34853fb534
Jul 03 23:53:40 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:40 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85" returned: 0 in 1.403s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:40 devstack sudo[91228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85
Jul 03 23:53:40 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:41 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bd6f1218-dafc-426c-9584-eb34853fb534" returned: 0 in 0.844s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] <== create_volume: return (2472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.474s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f74046a-0c4d-4510-a2c4-394601f7863e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd6f1218-dafc-426c-9584-eb34853fb534', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2453534e-a9ad-41a6-8a3c-6b1db9f1413f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:53:41 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Volume volume-bd6f1218-dafc-426c-9584-eb34853fb534 (bd6f1218-dafc-426c-9584-eb34853fb534): created successfully
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2453534e-a9ad-41a6-8a3c-6b1db9f1413f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Flow 'volume_create_manager' (ca77b366-212d-495f-a972-2189c19c36af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:53:41 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f9a8cebe-6204-44fe-9720-a7591a6d20ca tempest-VolumesActionsTest-83714045 None] Created volume successfully.
Jul 03 23:53:41 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-60d62046-7edb-48d3-bf01-09590ad07d85" returned: 0 in 1.028s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Lock "cinder-quobyte-60d62046-7edb-48d3-bf01-09590ad07d85" released by "delete_volume" :: held 2.511s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Created reservations ['bba42cf1-0822-436d-886b-73ca0cac0f9a', '2827a3de-7f2b-4b22-a32a-48d16a6a3ae7', 'c77b32e4-fd36-41d0-a0d7-dacbbcb5b8cf', '05d636de-6d6e-4e2f-9e5a-aa2ca15acb62'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-aa27c2f2-2aff-48d4-adb6-637e8b25654a tempest-VolumesActionsTest-83714045 None] Acquiring lock "cinder-bd6f1218-dafc-426c-9584-eb34853fb534" by "attach_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:41 devstack sudo[91234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:53:41 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-aa27c2f2-2aff-48d4-adb6-637e8b25654a tempest-VolumesActionsTest-83714045 None] Lock "cinder-bd6f1218-dafc-426c-9584-eb34853fb534" acquired by "attach_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:41 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-aa27c2f2-2aff-48d4-adb6-637e8b25654a tempest-VolumesActionsTest-83714045 None] Attaching volume bd6f1218-dafc-426c-9584-eb34853fb534 to instance 9cd296a5-8879-45fc-be12-9669df5f9cec at mountpoint /dev/vdb on host None.
Jul 03 23:53:41 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-aa27c2f2-2aff-48d4-adb6-637e8b25654a tempest-VolumesActionsTest-83714045 None] Attach volume completed successfully.
Jul 03 23:53:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-aa27c2f2-2aff-48d4-adb6-637e8b25654a tempest-VolumesActionsTest-83714045 None] Lock "cinder-bd6f1218-dafc-426c-9584-eb34853fb534" released by "attach_volume" :: held 0.134s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:42 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.007s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:42 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:53:42 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Deleted volume successfully.
Jul 03 23:53:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f84f8bce-6f7f-4cee-96a6-a65ad2d5dbbd tempest-ServerActionsTestOtherA-1861267644 None] Lock "cinder-60d62046-7edb-48d3-bf01-09590ad07d85-delete_volume" released by "delete_volume" :: held 3.912s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:43 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-8076e7b9-9020-4706-bf71-a2be4ca017f4 tempest-VolumesActionsTest-698448699 None] Terminate volume connection completed successfully.
Jul 03 23:53:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8076e7b9-9020-4706-bf71-a2be4ca017f4 tempest-VolumesActionsTest-698448699 None] Acquiring lock "cinder-bd6f1218-dafc-426c-9584-eb34853fb534-detach_volume" by "detach_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8076e7b9-9020-4706-bf71-a2be4ca017f4 tempest-VolumesActionsTest-698448699 None] Lock "cinder-bd6f1218-dafc-426c-9584-eb34853fb534-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:43 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-8076e7b9-9020-4706-bf71-a2be4ca017f4 tempest-VolumesActionsTest-698448699 None] Detaching volume bd6f1218-dafc-426c-9584-eb34853fb534 from instance 9cd296a5-8879-45fc-be12-9669df5f9cec.
Jul 03 23:53:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-8076e7b9-9020-4706-bf71-a2be4ca017f4 tempest-VolumesActionsTest-698448699 None] Detach volume completed successfully.
Jul 03 23:53:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8076e7b9-9020-4706-bf71-a2be4ca017f4 tempest-VolumesActionsTest-698448699 None] Lock "cinder-bd6f1218-dafc-426c-9584-eb34853fb534-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f860f845-2616-44c4-a47e-a9686d5582ec tempest-VolumesActionsTest-83714045 None] Acquiring lock "cinder-bd6f1218-dafc-426c-9584-eb34853fb534-detach_volume" by "detach_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f860f845-2616-44c4-a47e-a9686d5582ec tempest-VolumesActionsTest-83714045 None] Lock "cinder-bd6f1218-dafc-426c-9584-eb34853fb534-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f860f845-2616-44c4-a47e-a9686d5582ec tempest-VolumesActionsTest-83714045 None] Volume detach called, but volume not attached.
Jul 03 23:53:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f860f845-2616-44c4-a47e-a9686d5582ec tempest-VolumesActionsTest-83714045 None] Lock "cinder-bd6f1218-dafc-426c-9584-eb34853fb534-detach_volume" released by "detach_volume" :: held 0.054s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Acquiring lock "cinder-bd6f1218-dafc-426c-9584-eb34853fb534-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Lock "cinder-bd6f1218-dafc-426c-9584-eb34853fb534-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Acquiring lock "cinder-quobyte-bd6f1218-dafc-426c-9584-eb34853fb534" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:53:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Lock "cinder-quobyte-bd6f1218-dafc-426c-9584-eb34853fb534" acquired by "delete_volume" :: waited 0.058s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:53:46 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[97abaf7c-72e7-4f6f-b0cc-899712d23046]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:53:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bd6f1218-dafc-426c-9584-eb34853fb534 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:46 devstack sudo[91346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bd6f1218-dafc-426c-9584-eb34853fb534
Jul 03 23:53:46 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:47 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bd6f1218-dafc-426c-9584-eb34853fb534" returned: 0 in 1.349s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bd6f1218-dafc-426c-9584-eb34853fb534 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:47 devstack sudo[91355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bd6f1218-dafc-426c-9584-eb34853fb534
Jul 03 23:53:47 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:49 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bd6f1218-dafc-426c-9584-eb34853fb534" returned: 0 in 1.812s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Lock "cinder-quobyte-bd6f1218-dafc-426c-9584-eb34853fb534" released by "delete_volume" :: held 3.276s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:49 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Created reservations ['3c714e8d-ef1a-46cf-b44c-f837afdcb272', '5b847fc4-506c-4c4c-9510-57269cea9aba', 'c09308dc-501a-4429-a29b-1436b8ee9caf', 'a0cc8801-a3af-40a8-9793-f9e5cceafc1b'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:53:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:53:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:53:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:53:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:53:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:53:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:53:49 devstack sudo[91392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:53:49 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:53:50 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root
Jul 03 23:53:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.745s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:53:50 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:53:50 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Deleted volume successfully.
Jul 03 23:53:50 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea4bfdeb-e06e-4848-a2df-c571bb509b54 tempest-VolumesActionsTest-83714045 None] Lock "cinder-bd6f1218-dafc-426c-9584-eb34853fb534-delete_volume" released by "delete_volume" :: held 4.676s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:53:59 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=20,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:54:00 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=19,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Flow 'volume_create_manager' (a146c23f-095b-4cec-a224-eece7526434c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3180f7-7068-44a6-a4ad-db87c3cc3526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3180f7-7068-44a6-a4ad-db87c3cc3526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1592295617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4261f0d-93fc-4280-a427-114f7a62e437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094aaff95d50448c99854c1d6913b79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:02Z,use_quota=True,user_id='0c2fc70688c248f1bcca0932ece0c133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb4d440-89a3-440a-8f54-590bc2ba4cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cb4d440-89a3-440a-8f54-590bc2ba4cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0cb61b-970b-44d7-98cd-6b6ef6d144db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc0cb61b-970b-44d7-98cd-6b6ef6d144db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4261f0d-93fc-4280-a427-114f7a62e437', 'volume_name': 'volume-a4261f0d-93fc-4280-a427-114f7a62e437', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38fa0149-b2c4-45e6-9b23-d710ad4cf153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38fa0149-b2c4-45e6-9b23-d710ad4cf153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f40701-0c76-4fb4-be13-51318f0f7d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:02 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Volume a4261f0d-93fc-4280-a427-114f7a62e437: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4261f0d-93fc-4280-a427-114f7a62e437', 'volume_size': 1}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1592295617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4261f0d-93fc-4280-a427-114f7a62e437,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094aaff95d50448c99854c1d6913b79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:02Z,use_quota=True,user_id='0c2fc70688c248f1bcca0932ece0c133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Creating volume a4261f0d-93fc-4280-a427-114f7a62e437 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:54:02 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:54:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a4261f0d-93fc-4280-a427-114f7a62e437 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:02 devstack sudo[91488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a4261f0d-93fc-4280-a427-114f7a62e437 1073741824
Jul 03 23:54:02 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:03 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a4261f0d-93fc-4280-a427-114f7a62e437 1073741824" returned: 0 in 1.250s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a4261f0d-93fc-4280-a427-114f7a62e437 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:03 devstack sudo[91516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a4261f0d-93fc-4280-a427-114f7a62e437
Jul 03 23:54:03 devstack sudo[91516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:05 devstack sudo[91516]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a4261f0d-93fc-4280-a427-114f7a62e437" returned: 0 in 1.144s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] <== create_volume: return (2588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:54:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.592s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f40701-0c76-4fb4-be13-51318f0f7d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4261f0d-93fc-4280-a427-114f7a62e437', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c389cdee-7670-4c4a-acda-e324c6ffb61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:05 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Volume volume-a4261f0d-93fc-4280-a427-114f7a62e437 (a4261f0d-93fc-4280-a427-114f7a62e437): created successfully
Jul 03 23:54:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c389cdee-7670-4c4a-acda-e324c6ffb61c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Flow 'volume_create_manager' (a146c23f-095b-4cec-a224-eece7526434c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:05 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-730140f5-74a6-4990-a835-ac5a52f82912 tempest-VolumesActionsTest-83714045 None] Created volume successfully.
Jul 03 23:54:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Acquiring lock "cinder-a4261f0d-93fc-4280-a427-114f7a62e437-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Lock "cinder-a4261f0d-93fc-4280-a427-114f7a62e437-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Acquiring lock "cinder-quobyte-a4261f0d-93fc-4280-a427-114f7a62e437" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Lock "cinder-quobyte-a4261f0d-93fc-4280-a427-114f7a62e437" acquired by "delete_volume" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:06 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d2b6ab-4aa1-43a7-97a9-9c29368d9357]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a4261f0d-93fc-4280-a427-114f7a62e437 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:06 devstack sudo[91551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a4261f0d-93fc-4280-a427-114f7a62e437
Jul 03 23:54:06 devstack sudo[91551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:06 devstack sudo[91551]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a4261f0d-93fc-4280-a427-114f7a62e437" returned: 0 in 0.921s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a4261f0d-93fc-4280-a427-114f7a62e437 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:06 devstack sudo[91559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a4261f0d-93fc-4280-a427-114f7a62e437
Jul 03 23:54:06 devstack sudo[91559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:07 devstack sudo[91559]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a4261f0d-93fc-4280-a427-114f7a62e437" returned: 0 in 1.034s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Lock "cinder-quobyte-a4261f0d-93fc-4280-a427-114f7a62e437" released by "delete_volume" :: held 2.028s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:08 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Created reservations ['6da9e6ba-093f-49c7-a078-39d3fd347142', 'da005f73-deea-41dc-b1d8-24d72568eb78', 'c4a7a2ad-47b5-4c28-8bda-ae3566f940ec', '41238a17-8f57-4a07-900d-0e9acd5ef9b9'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:54:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:08 devstack sudo[91562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:54:08 devstack sudo[91562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Flow 'volume_create_manager' (98f660b6-d684-46c2-9e54-0bb0aef60d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5042ce4e-5d0a-48c4-a14c-06cf34a120d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5042ce4e-5d0a-48c4-a14c-06cf34a120d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-61447455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f435f15-eef2-4109-811c-c757fb80028d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094aaff95d50448c99854c1d6913b79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:09Z,use_quota=True,user_id='0c2fc70688c248f1bcca0932ece0c133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb41918-d391-4846-baa6-3c7134ba4443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fb41918-d391-4846-baa6-3c7134ba4443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b62d78c-ae36-4a35-a3e7-034ec21ec7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b62d78c-ae36-4a35-a3e7-034ec21ec7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f435f15-eef2-4109-811c-c757fb80028d', 'volume_name': 'volume-9f435f15-eef2-4109-811c-c757fb80028d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb189325-c728-4ec7-8a6d-d00bdefdfd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb189325-c728-4ec7-8a6d-d00bdefdfd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da907e9-f2eb-4b34-827d-f84dea4fc8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:09 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Volume 9f435f15-eef2-4109-811c-c757fb80028d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f435f15-eef2-4109-811c-c757fb80028d', 'volume_size': 1}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-61447455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f435f15-eef2-4109-811c-c757fb80028d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094aaff95d50448c99854c1d6913b79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:09Z,use_quota=True,user_id='0c2fc70688c248f1bcca0932ece0c133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Creating volume 9f435f15-eef2-4109-811c-c757fb80028d {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:54:09 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9f435f15-eef2-4109-811c-c757fb80028d 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:09 devstack sudo[91566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9f435f15-eef2-4109-811c-c757fb80028d 1073741824
Jul 03 23:54:09 devstack sudo[91566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:09 devstack sudo[91562]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.720s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:54:09 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Deleted volume successfully.
Jul 03 23:54:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-40535587-242e-490c-a3fa-aa0e9d184507 tempest-VolumesActionsTest-698448699 None] Lock "cinder-a4261f0d-93fc-4280-a427-114f7a62e437-delete_volume" released by "delete_volume" :: held 4.115s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:11 devstack sudo[91566]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9f435f15-eef2-4109-811c-c757fb80028d 1073741824" returned: 0 in 1.436s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9f435f15-eef2-4109-811c-c757fb80028d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:11 devstack sudo[91577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9f435f15-eef2-4109-811c-c757fb80028d
Jul 03 23:54:11 devstack sudo[91577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:12 devstack sudo[91577]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9f435f15-eef2-4109-811c-c757fb80028d" returned: 0 in 0.923s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] <== create_volume: return (2432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:54:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.435s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5da907e9-f2eb-4b34-827d-f84dea4fc8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f435f15-eef2-4109-811c-c757fb80028d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f2a3c2-71fc-4e4f-baf5-9f216b0b5543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:12 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Volume volume-9f435f15-eef2-4109-811c-c757fb80028d (9f435f15-eef2-4109-811c-c757fb80028d): created successfully
Jul 03 23:54:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f2a3c2-71fc-4e4f-baf5-9f216b0b5543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Flow 'volume_create_manager' (98f660b6-d684-46c2-9e54-0bb0aef60d31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:12 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-8c131740-fd58-4c8e-b9c9-22a72f5b69d4 tempest-VolumesActionsTest-83714045 None] Created volume successfully.
Jul 03 23:54:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Acquiring lock "cinder-9f435f15-eef2-4109-811c-c757fb80028d-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Lock "cinder-9f435f15-eef2-4109-811c-c757fb80028d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Acquiring lock "cinder-quobyte-9f435f15-eef2-4109-811c-c757fb80028d" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Lock "cinder-quobyte-9f435f15-eef2-4109-811c-c757fb80028d" acquired by "delete_volume" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:12 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5588cd6e-42b8-4069-90cc-cdcc61f9e751]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9f435f15-eef2-4109-811c-c757fb80028d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:13 devstack sudo[91614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9f435f15-eef2-4109-811c-c757fb80028d
Jul 03 23:54:13 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:13 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9f435f15-eef2-4109-811c-c757fb80028d" returned: 0 in 0.977s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9f435f15-eef2-4109-811c-c757fb80028d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:13 devstack sudo[91623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9f435f15-eef2-4109-811c-c757fb80028d
Jul 03 23:54:13 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:54:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:14 devstack sudo[91625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:54:14 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9f435f15-eef2-4109-811c-c757fb80028d" returned: 0 in 0.767s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:14 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Lock "cinder-quobyte-9f435f15-eef2-4109-811c-c757fb80028d" released by "delete_volume" :: held 1.839s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:14 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Created reservations ['2b8d6059-f8ed-4b35-b8f8-767ef293eefa', '656cabd1-c6ed-4b7c-add8-e85d504fc076', '39d48a7e-2e0b-45bd-89f3-2676633787e3', '711d23f0-bc41-45cb-804f-a34acc9ab45d'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:54:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:15 devstack sudo[91628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:54:15 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:15 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.326s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:54:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:54:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 8 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:54:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:54:15 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.909s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:54:15 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Deleted volume successfully.
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-770e63c3-d879-411e-9898-20416ad4d948 tempest-VolumesActionsTest-698448699 None] Lock "cinder-9f435f15-eef2-4109-811c-c757fb80028d-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Flow 'volume_create_manager' (7615601f-0771-4e49-8cd8-438e8047ffa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f52b3a-59b8-454b-af0d-f2ca7a99d148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02f52b3a-59b8-454b-af0d-f2ca7a99d148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-878628941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b200df-62b6-462b-8641-be6dd49ef73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094aaff95d50448c99854c1d6913b79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:16Z,use_quota=True,user_id='0c2fc70688c248f1bcca0932ece0c133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9db2b9-b325-496c-b66e-ee5d12d99d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9db2b9-b325-496c-b66e-ee5d12d99d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d175813-ef9b-4022-8278-754a6e79dabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d175813-ef9b-4022-8278-754a6e79dabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b200df-62b6-462b-8641-be6dd49ef73c', 'volume_name': 'volume-c0b200df-62b6-462b-8641-be6dd49ef73c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecd691e-aa6b-4f04-9a43-57b5d0be0150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aecd691e-aa6b-4f04-9a43-57b5d0be0150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694776b1-e09a-45c6-a8ee-4642f3a26858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:16 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Volume c0b200df-62b6-462b-8641-be6dd49ef73c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b200df-62b6-462b-8641-be6dd49ef73c', 'volume_size': 1}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-878628941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b200df-62b6-462b-8641-be6dd49ef73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094aaff95d50448c99854c1d6913b79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:16Z,use_quota=True,user_id='0c2fc70688c248f1bcca0932ece0c133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Creating volume c0b200df-62b6-462b-8641-be6dd49ef73c {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:54:16 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:54:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c0b200df-62b6-462b-8641-be6dd49ef73c 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:16 devstack sudo[91633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c0b200df-62b6-462b-8641-be6dd49ef73c 1073741824
Jul 03 23:54:16 devstack sudo[91633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:17 devstack sudo[91633]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c0b200df-62b6-462b-8641-be6dd49ef73c 1073741824" returned: 0 in 1.161s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c0b200df-62b6-462b-8641-be6dd49ef73c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:17 devstack sudo[91639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c0b200df-62b6-462b-8641-be6dd49ef73c
Jul 03 23:54:17 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:18 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c0b200df-62b6-462b-8641-be6dd49ef73c" returned: 0 in 1.066s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] <== create_volume: return (2281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:54:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.283s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694776b1-e09a-45c6-a8ee-4642f3a26858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b200df-62b6-462b-8641-be6dd49ef73c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b41fd1b-c5da-4a2f-b25f-712a0c92d63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:18 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Volume volume-c0b200df-62b6-462b-8641-be6dd49ef73c (c0b200df-62b6-462b-8641-be6dd49ef73c): created successfully
Jul 03 23:54:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b41fd1b-c5da-4a2f-b25f-712a0c92d63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Flow 'volume_create_manager' (7615601f-0771-4e49-8cd8-438e8047ffa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:18 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ae25319d-ef46-4cbb-aa5c-8933f8cafa9b tempest-VolumesActionsTest-83714045 None] Created volume successfully.
Jul 03 23:54:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Acquiring lock "cinder-c0b200df-62b6-462b-8641-be6dd49ef73c-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Lock "cinder-c0b200df-62b6-462b-8641-be6dd49ef73c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Acquiring lock "cinder-quobyte-c0b200df-62b6-462b-8641-be6dd49ef73c" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Lock "cinder-quobyte-c0b200df-62b6-462b-8641-be6dd49ef73c" acquired by "delete_volume" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:19 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8d2557-4e6e-4da6-a192-e62a00c4c60c]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c0b200df-62b6-462b-8641-be6dd49ef73c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:19 devstack sudo[91708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c0b200df-62b6-462b-8641-be6dd49ef73c
Jul 03 23:54:19 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:20 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:54:20 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Flow 'volume_create_manager' (1a69b373-bd74-4528-b3f6-14136c893d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (655a741e-0cef-491d-bda6-3917fd2b74ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c0b200df-62b6-462b-8641-be6dd49ef73c" returned: 0 in 1.206s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c0b200df-62b6-462b-8641-be6dd49ef73c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (655a741e-0cef-491d-bda6-3917fd2b74ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1042710448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98327d74-5705-43be-81f5-329482b87564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e515e3b64e40978b1febd1d8d1e26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:21Z,use_quota=True,user_id='e97a77bd2e654bd8bac93c402f712f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09949b82-35fa-4d9a-9f3e-69152b158fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:20 devstack sudo[91716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c0b200df-62b6-462b-8641-be6dd49ef73c
Jul 03 23:54:20 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09949b82-35fa-4d9a-9f3e-69152b158fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9bd214b-454a-4a6d-a729-2660208ac5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9bd214b-454a-4a6d-a729-2660208ac5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98327d74-5705-43be-81f5-329482b87564', 'volume_name': 'volume-98327d74-5705-43be-81f5-329482b87564', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18a7ef2-52de-4dbf-ada4-f7a591929c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18a7ef2-52de-4dbf-ada4-f7a591929c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a0e822-59c1-44fb-9af8-06bc46996af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:21 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Volume 98327d74-5705-43be-81f5-329482b87564: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98327d74-5705-43be-81f5-329482b87564', 'volume_size': 1}
Jul 03 23:54:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1042710448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98327d74-5705-43be-81f5-329482b87564,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e515e3b64e40978b1febd1d8d1e26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:21Z,use_quota=True,user_id='e97a77bd2e654bd8bac93c402f712f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:54:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Creating volume 98327d74-5705-43be-81f5-329482b87564 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:54:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:54:21 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:54:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-98327d74-5705-43be-81f5-329482b87564 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:21 devstack sudo[91718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-98327d74-5705-43be-81f5-329482b87564 1073741824
Jul 03 23:54:21 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:22 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c0b200df-62b6-462b-8641-be6dd49ef73c" returned: 0 in 1.573s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Lock "cinder-quobyte-c0b200df-62b6-462b-8641-be6dd49ef73c" released by "delete_volume" :: held 2.856s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:22 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Created reservations ['17629685-391a-470b-879d-199d7b6974e9', '68d12658-27f2-4673-84bc-0bcf9e3bba9b', '3c874b02-46e3-48d3-b731-78e4510011c8', 'deb2486d-7830-47e4-8c84-df0f5a2ee1aa'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:54:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:22 devstack sudo[91724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:54:22 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:22 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-98327d74-5705-43be-81f5-329482b87564 1073741824" returned: 0 in 1.941s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-98327d74-5705-43be-81f5-329482b87564 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:23 devstack sudo[91728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-98327d74-5705-43be-81f5-329482b87564
Jul 03 23:54:23 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:24 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.381s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:54:24 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Deleted volume successfully.
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-760818dd-1c42-47bb-9895-0c938c508861 tempest-VolumesActionsTest-698448699 None] Lock "cinder-c0b200df-62b6-462b-8641-be6dd49ef73c-delete_volume" released by "delete_volume" :: held 4.571s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:24 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-98327d74-5705-43be-81f5-329482b87564" returned: 0 in 1.195s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] <== create_volume: return (3269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.274s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a0e822-59c1-44fb-9af8-06bc46996af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98327d74-5705-43be-81f5-329482b87564', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9108eaee-0a04-4f0d-96fc-9c691a30e615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Flow 'volume_create_manager' (b94af42d-a3a8-4ce3-8df7-a44f00a011a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac9ecf6-0223-4ddd-bfd2-7bbdab9f691b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:24 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Volume volume-98327d74-5705-43be-81f5-329482b87564 (98327d74-5705-43be-81f5-329482b87564): created successfully
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9108eaee-0a04-4f0d-96fc-9c691a30e615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Flow 'volume_create_manager' (1a69b373-bd74-4528-b3f6-14136c893d63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac9ecf6-0223-4ddd-bfd2-7bbdab9f691b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1270983421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094aaff95d50448c99854c1d6913b79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:24Z,use_quota=True,user_id='0c2fc70688c248f1bcca0932ece0c133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756c0539-9578-4154-89c8-f28a0d50ca67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756c0539-9578-4154-89c8-f28a0d50ca67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af9ef58-8894-4f54-8963-68adc4d2eb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8af9ef58-8894-4f54-8963-68adc4d2eb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8', 'volume_name': 'volume-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c6df3b-9e64-4a49-9e38-0e0fa7741fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c6df3b-9e64-4a49-9e38-0e0fa7741fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e09930-3059-4882-afa8-4f58c6f5b6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:24 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Volume b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8', 'volume_size': 1}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1270983421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094aaff95d50448c99854c1d6913b79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:24Z,use_quota=True,user_id='0c2fc70688c248f1bcca0932ece0c133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Creating volume b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:54:24 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:54:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:24 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9f49dd04-7c32-49fe-a63b-41ef52a1a98c tempest-ServersNegativeTestJSON-1968342397 None] Created volume successfully.
Jul 03 23:54:24 devstack sudo[91732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8 1073741824
Jul 03 23:54:24 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:25 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8 1073741824" returned: 0 in 1.144s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:25 devstack sudo[91738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8
Jul 03 23:54:25 devstack sudo[91738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:26 devstack sudo[91738]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8" returned: 0 in 0.884s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:54:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e09930-3059-4882-afa8-4f58c6f5b6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2c32dd-5c74-44ec-8edd-295f083f570e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:26 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Volume volume-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8 (b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8): created successfully
Jul 03 23:54:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2c32dd-5c74-44ec-8edd-295f083f570e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Flow 'volume_create_manager' (b94af42d-a3a8-4ce3-8df7-a44f00a011a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:26 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7c5caaf3-5e6f-4f44-bbf3-85d30c21f3e0 tempest-VolumesActionsTest-83714045 None] Created volume successfully.
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Flow 'volume_create_manager' (e77bf9f0-7051-4fa3-8e54-7c6047eb8d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08b5fc6-c4b0-4075-8810-87162d7c21c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08b5fc6-c4b0-4075-8810-87162d7c21c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1681098217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7255e06b-8473-4ec8-b13c-35c54b16c578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e515e3b64e40978b1febd1d8d1e26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:28Z,use_quota=True,user_id='e97a77bd2e654bd8bac93c402f712f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1a3c37-e1c6-44ee-ad4a-8daa62413c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1a3c37-e1c6-44ee-ad4a-8daa62413c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb791839-8d43-4700-a31d-01610e4a1db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb791839-8d43-4700-a31d-01610e4a1db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7255e06b-8473-4ec8-b13c-35c54b16c578', 'volume_name': 'volume-7255e06b-8473-4ec8-b13c-35c54b16c578', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4b2892-78ea-4fa6-bb9c-c38ec5acbda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4b2892-78ea-4fa6-bb9c-c38ec5acbda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2071e51-a5b6-40dc-a1d9-3f9c0dddc0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:27 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Volume 7255e06b-8473-4ec8-b13c-35c54b16c578: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7255e06b-8473-4ec8-b13c-35c54b16c578', 'volume_size': 1}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1681098217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7255e06b-8473-4ec8-b13c-35c54b16c578,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88e515e3b64e40978b1febd1d8d1e26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:28Z,use_quota=True,user_id='e97a77bd2e654bd8bac93c402f712f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Creating volume 7255e06b-8473-4ec8-b13c-35c54b16c578 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:54:27 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7255e06b-8473-4ec8-b13c-35c54b16c578 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Acquiring lock "cinder-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:27 devstack sudo[91743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7255e06b-8473-4ec8-b13c-35c54b16c578 1073741824
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Lock "cinder-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:27 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Acquiring lock "cinder-quobyte-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Lock "cinder-quobyte-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[344b295c-b5dd-4a03-b1d9-6484449529e3]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:28 devstack sudo[91746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8
Jul 03 23:54:28 devstack sudo[91746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:29 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7255e06b-8473-4ec8-b13c-35c54b16c578 1073741824" returned: 0 in 1.348s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7255e06b-8473-4ec8-b13c-35c54b16c578 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:29 devstack sudo[91759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7255e06b-8473-4ec8-b13c-35c54b16c578
Jul 03 23:54:29 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:29 devstack sudo[91746]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8" returned: 0 in 1.144s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:29 devstack sudo[91761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8
Jul 03 23:54:29 devstack sudo[91761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:29 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7255e06b-8473-4ec8-b13c-35c54b16c578" returned: 0 in 0.728s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] <== create_volume: return (2127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:54:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.130s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2071e51-a5b6-40dc-a1d9-3f9c0dddc0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7255e06b-8473-4ec8-b13c-35c54b16c578', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389e62f9-9211-4d2f-bb1a-bd561bee01cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:29 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Volume volume-7255e06b-8473-4ec8-b13c-35c54b16c578 (7255e06b-8473-4ec8-b13c-35c54b16c578): created successfully
Jul 03 23:54:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (389e62f9-9211-4d2f-bb1a-bd561bee01cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Flow 'volume_create_manager' (e77bf9f0-7051-4fa3-8e54-7c6047eb8d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:29 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bc8108d7-6900-47c1-bfec-07e21be4f3ea tempest-ServersNegativeTestJSON-1968342397 None] Created volume successfully.
Jul 03 23:54:30 devstack sudo[91761]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8" returned: 0 in 0.883s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Lock "cinder-quobyte-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8" released by "delete_volume" :: held 2.081s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:30 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Created reservations ['099f3aa9-3836-4c2a-b6a7-f65d37586cab', '531ff4a2-a125-4ab2-ad92-9676a872489e', '286f31fe-ec20-41ce-bb2d-bc7b7df4ead4', '5f366371-2570-494c-adf8-ec234498e485'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:54:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:30 devstack sudo[91766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:54:30 devstack sudo[91766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:30 devstack sudo[91766]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.641s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:30 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:54:30 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Deleted volume successfully.
Jul 03 23:54:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea0f07be-5c8e-461d-a992-4e95f198cacb tempest-VolumesActionsTest-698448699 None] Lock "cinder-b3fc22d3-3b29-473f-ae63-6ccf32cc0ca8-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Acquiring lock "cinder-7255e06b-8473-4ec8-b13c-35c54b16c578-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Lock "cinder-7255e06b-8473-4ec8-b13c-35c54b16c578-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Acquiring lock "cinder-quobyte-7255e06b-8473-4ec8-b13c-35c54b16c578" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Lock "cinder-quobyte-7255e06b-8473-4ec8-b13c-35c54b16c578" acquired by "delete_volume" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f28b0e-ee60-48a1-8228-ba67f18b94f1]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7255e06b-8473-4ec8-b13c-35c54b16c578 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:31 devstack sudo[91769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7255e06b-8473-4ec8-b13c-35c54b16c578
Jul 03 23:54:31 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Flow 'volume_create_manager' (1212bcf1-3f33-456e-976a-ed6a7b121333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4cdb70-8d68-4db2-a60e-ba359bec0f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4cdb70-8d68-4db2-a60e-ba359bec0f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-812440704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40040efb-008b-4b9b-b496-c4fd80664f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094aaff95d50448c99854c1d6913b79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:32Z,use_quota=True,user_id='0c2fc70688c248f1bcca0932ece0c133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b15c89e-9c32-4b49-9aff-064c0a895306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b15c89e-9c32-4b49-9aff-064c0a895306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2f8956-e1e4-4821-bbe3-eaa28cc05f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2f8956-e1e4-4821-bbe3-eaa28cc05f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40040efb-008b-4b9b-b496-c4fd80664f92', 'volume_name': 'volume-40040efb-008b-4b9b-b496-c4fd80664f92', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233a137e-b4da-4376-9b08-09abad436b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233a137e-b4da-4376-9b08-09abad436b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ec2610-6902-4b4c-b605-ecd71f0eecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:31 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Volume 40040efb-008b-4b9b-b496-c4fd80664f92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40040efb-008b-4b9b-b496-c4fd80664f92', 'volume_size': 1}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-812440704',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40040efb-008b-4b9b-b496-c4fd80664f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='094aaff95d50448c99854c1d6913b79b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:32Z,use_quota=True,user_id='0c2fc70688c248f1bcca0932ece0c133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Creating volume 40040efb-008b-4b9b-b496-c4fd80664f92 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:54:31 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:54:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40040efb-008b-4b9b-b496-c4fd80664f92 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:31 devstack sudo[91771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40040efb-008b-4b9b-b496-c4fd80664f92 1073741824
Jul 03 23:54:32 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:32 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7255e06b-8473-4ec8-b13c-35c54b16c578" returned: 0 in 0.902s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7255e06b-8473-4ec8-b13c-35c54b16c578 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:32 devstack sudo[91777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7255e06b-8473-4ec8-b13c-35c54b16c578
Jul 03 23:54:32 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:33 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40040efb-008b-4b9b-b496-c4fd80664f92 1073741824" returned: 0 in 1.070s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40040efb-008b-4b9b-b496-c4fd80664f92 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:33 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7255e06b-8473-4ec8-b13c-35c54b16c578" returned: 0 in 0.881s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:33 devstack sudo[91785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40040efb-008b-4b9b-b496-c4fd80664f92
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Lock "cinder-quobyte-7255e06b-8473-4ec8-b13c-35c54b16c578" released by "delete_volume" :: held 1.838s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:33 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Created reservations ['2e7c0bc4-1adb-4e6a-a038-628d769d012c', 'b6ed04ce-ba86-4f57-83b4-7ac2c087251c', '36b2408c-fed5-4afd-b39b-18290a68d921', 'c20315b9-1545-4838-9aa2-93a70225043b'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:33 devstack sudo[91811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:54:33 devstack sudo[91811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Acquiring lock "cinder-98327d74-5705-43be-81f5-329482b87564-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Lock "cinder-98327d74-5705-43be-81f5-329482b87564-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Acquiring lock "cinder-quobyte-98327d74-5705-43be-81f5-329482b87564" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Lock "cinder-quobyte-98327d74-5705-43be-81f5-329482b87564" acquired by "delete_volume" :: waited 0.030s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e477c81-180f-42e4-8b8b-3a084a451c88]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-98327d74-5705-43be-81f5-329482b87564 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:34 devstack sudo[91819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-98327d74-5705-43be-81f5-329482b87564
Jul 03 23:54:34 devstack sudo[91819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:34 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40040efb-008b-4b9b-b496-c4fd80664f92" returned: 0 in 1.133s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:34 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] <== create_volume: return (2317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:54:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.320s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17ec2610-6902-4b4c-b605-ecd71f0eecc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40040efb-008b-4b9b-b496-c4fd80664f92', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (658144c7-90d8-4432-a02d-544803b1fe3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:34 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Volume volume-40040efb-008b-4b9b-b496-c4fd80664f92 (40040efb-008b-4b9b-b496-c4fd80664f92): created successfully
Jul 03 23:54:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (658144c7-90d8-4432-a02d-544803b1fe3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Flow 'volume_create_manager' (1212bcf1-3f33-456e-976a-ed6a7b121333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:34 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-029a1db9-2ea8-412f-b3c6-71b9a2592254 tempest-VolumesActionsTest-83714045 None] Created volume successfully.
Jul 03 23:54:34 devstack sudo[91811]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.064s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:34 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:54:34 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Deleted volume successfully.
Jul 03 23:54:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ad7bc3d5-d921-4502-8fa1-c4824568f4fc tempest-ServersNegativeTestJSON-1968342397 None] Lock "cinder-7255e06b-8473-4ec8-b13c-35c54b16c578-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:35 devstack sudo[91819]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-98327d74-5705-43be-81f5-329482b87564" returned: 0 in 1.091s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-98327d74-5705-43be-81f5-329482b87564 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:35 devstack sudo[91826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-98327d74-5705-43be-81f5-329482b87564
Jul 03 23:54:35 devstack sudo[91826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Acquiring lock "cinder-40040efb-008b-4b9b-b496-c4fd80664f92-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Lock "cinder-40040efb-008b-4b9b-b496-c4fd80664f92-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:35 devstack sudo[91826]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-98327d74-5705-43be-81f5-329482b87564" returned: 0 in 0.835s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Lock "cinder-quobyte-98327d74-5705-43be-81f5-329482b87564" released by "delete_volume" :: held 2.016s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Acquiring lock "cinder-quobyte-40040efb-008b-4b9b-b496-c4fd80664f92" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:54:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Lock "cinder-quobyte-40040efb-008b-4b9b-b496-c4fd80664f92" acquired by "delete_volume" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:54:35 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7b35f4-0820-4c5f-b4c3-ed998e6fd29a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40040efb-008b-4b9b-b496-c4fd80664f92 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:36 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Created reservations ['481a929e-9c5c-40cc-933f-5b5c3a5b4f04', '9a0a84a5-ddc6-4119-ad7a-cf0c3925b3dd', '43c03ef3-28fa-47d8-8ee2-e49f3ccb2f7f', 'da462b4b-c1a3-4bd1-bed6-8589224cc201'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:54:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:36 devstack sudo[91835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40040efb-008b-4b9b-b496-c4fd80664f92
Jul 03 23:54:36 devstack sudo[91835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:36 devstack sudo[91846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:54:36 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:36 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.691s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:36 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:54:36 devstack sudo[91835]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40040efb-008b-4b9b-b496-c4fd80664f92" returned: 0 in 0.869s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40040efb-008b-4b9b-b496-c4fd80664f92 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:36 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Deleted volume successfully.
Jul 03 23:54:36 devstack sudo[91858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40040efb-008b-4b9b-b496-c4fd80664f92
Jul 03 23:54:36 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3ddcb8f0-7f2a-4abf-8cd5-8a39bacf000c tempest-ServersNegativeTestJSON-1968342397 None] Lock "cinder-98327d74-5705-43be-81f5-329482b87564-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:37 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-40040efb-008b-4b9b-b496-c4fd80664f92" returned: 0 in 0.716s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Lock "cinder-quobyte-40040efb-008b-4b9b-b496-c4fd80664f92" released by "delete_volume" :: held 1.632s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:37 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Created reservations ['08df8c08-c4bf-4dc2-9da6-ce992e757383', '03a6e872-8af6-4a56-8419-bc24d766928e', '2a4917b7-c1c6-454a-9feb-1d42e2782d0c', 'addfcbec-f4fa-4131-8f9c-c2ab9fe37594'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:54:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:37 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:37 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:37 devstack sudo[91862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:54:37 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:38 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.673s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:38 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:54:38 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Deleted volume successfully.
Jul 03 23:54:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d5dbbeb4-5f2d-4810-be19-35a9c9b9816f tempest-VolumesActionsTest-83714045 None] Lock "cinder-40040efb-008b-4b9b-b496-c4fd80664f92-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Flow 'volume_create_manager' (af46a3a7-6b23-4079-9748-ee0c804b2696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57aed7d-30ae-452f-a849-f74159d63ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b57aed7d-30ae-452f-a849-f74159d63ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-325564593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f7420cf7444f0ebf8776f635192182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:47Z,use_quota=True,user_id='742dfd6c566d4e50a3626e01e3212151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89759eaf-5293-4b70-8eb8-8a4486e11cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89759eaf-5293-4b70-8eb8-8a4486e11cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20296305-56b6-4247-9303-9e4235a78969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20296305-56b6-4247-9303-9e4235a78969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4', 'volume_name': 'volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c9878a-a559-4040-8c89-b67b6f1c652d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74c9878a-a559-4040-8c89-b67b6f1c652d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ac4c85-64c4-4738-8cfc-9b312661ad5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:46 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Volume aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4', 'volume_size': 1}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-325564593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f7420cf7444f0ebf8776f635192182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:47Z,use_quota=True,user_id='742dfd6c566d4e50a3626e01e3212151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Creating volume aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:54:46 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:54:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:46 devstack sudo[91998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4 1073741824
Jul 03 23:54:46 devstack sudo[91998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:48 devstack sudo[91998]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4 1073741824" returned: 0 in 1.327s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:48 devstack sudo[92006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4
Jul 03 23:54:48 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:49 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4" returned: 0 in 1.021s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] <== create_volume: return (2425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:54:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.428s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ac4c85-64c4-4738-8cfc-9b312661ad5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f0c349-a832-4ebc-99da-89e79a20add2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:49 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Volume volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4 (aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4): created successfully
Jul 03 23:54:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f0c349-a832-4ebc-99da-89e79a20add2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Flow 'volume_create_manager' (af46a3a7-6b23-4079-9748-ee0c804b2696) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:49 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ad1a9870-7eef-4a14-b178-d60614992836 tempest-AttachVolumeTestJSON-383063172 None] Created volume successfully.
Jul 03 23:54:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-bddb8181-6f6a-4612-a66d-6d7923248538 req-cbd05fe1-387c-44ce-aa98-d52c030692b0 tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-bddb8181-6f6a-4612-a66d-6d7923248538 req-cbd05fe1-387c-44ce-aa98-d52c030692b0 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:53 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5384d8b-6f63-467f-b5e8-5c870b1b9479]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:54:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-bddb8181-6f6a-4612-a66d-6d7923248538 req-cbd05fe1-387c-44ce-aa98-d52c030692b0 tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:54 devstack sudo[92026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4
Jul 03 23:54:54 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:55 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-bddb8181-6f6a-4612-a66d-6d7923248538 req-cbd05fe1-387c-44ce-aa98-d52c030692b0 tempest-AttachVolumeTestJSON-383063172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4" returned: 0 in 1.136s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-bddb8181-6f6a-4612-a66d-6d7923248538 req-cbd05fe1-387c-44ce-aa98-d52c030692b0 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.171s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-bddb8181-6f6a-4612-a66d-6d7923248538 req-cbd05fe1-387c-44ce-aa98-d52c030692b0 tempest-AttachVolumeTestJSON-383063172 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88bd9d81-dad0-4db1-a994-0b0402cf0ff2', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:54:55 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-bddb8181-6f6a-4612-a66d-6d7923248538 req-cbd05fe1-387c-44ce-aa98-d52c030692b0 tempest-AttachVolumeTestJSON-383063172 None] attachment_update completed successfully.
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Flow 'volume_create_manager' (75fb5ef6-745b-494c-a461-faa20b964190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5656695f-f68f-4088-9244-8cc9bed80999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5656695f-f68f-4088-9244-8cc9bed80999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1150317613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a23403-c5c2-4f5e-a115-dcb5fe87cd60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f81b155f046b4a11b89f9865fe82f845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:57Z,use_quota=True,user_id='6ce6cc5f33704b3c85a7ff6dff7f4c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136cf4a3-5832-4222-845f-6510c377da87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136cf4a3-5832-4222-845f-6510c377da87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf75950c-cda2-4d87-b0a8-50ade8ed54a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf75950c-cda2-4d87-b0a8-50ade8ed54a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0a23403-c5c2-4f5e-a115-dcb5fe87cd60', 'volume_name': 'volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd1fc05-3772-456e-8641-4ff9d4fae267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bd1fc05-3772-456e-8641-4ff9d4fae267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8216774f-edec-4397-a53b-8f84b479c989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:56 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Volume a0a23403-c5c2-4f5e-a115-dcb5fe87cd60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60', 'volume_size': 1}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1150317613',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a23403-c5c2-4f5e-a115-dcb5fe87cd60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f81b155f046b4a11b89f9865fe82f845',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:57Z,use_quota=True,user_id='6ce6cc5f33704b3c85a7ff6dff7f4c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Creating volume a0a23403-c5c2-4f5e-a115-dcb5fe87cd60 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:54:56 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:54:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:56 devstack sudo[92445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60 1073741824
Jul 03 23:54:56 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:57 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:54:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Flow 'volume_create_manager' (bb170a37-acc6-4296-bf6c-691dce1f9c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d913a4-12f2-4392-bc82-d360dfadc631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88d913a4-12f2-4392-bc82-d360dfadc631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-469243085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d579563b-53a7-471f-8466-e3b29cfc0686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940a05ab895d42b892b45f9496d98dfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:57Z,use_quota=True,user_id='0b4a2f695d5041da8516542ab49c7ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da85d17-7d07-49f7-bb01-4dc6b3e83d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9da85d17-7d07-49f7-bb01-4dc6b3e83d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db0e520-845d-434f-97a1-546db01e2188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db0e520-845d-434f-97a1-546db01e2188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd579563b-53a7-471f-8466-e3b29cfc0686', 'volume_name': 'volume-d579563b-53a7-471f-8466-e3b29cfc0686', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381a5ae7-f388-48fc-992b-732eb70bceb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381a5ae7-f388-48fc-992b-732eb70bceb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa0e51d-ac5e-42db-91fd-3ddebb0f021e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:57 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Volume d579563b-53a7-471f-8466-e3b29cfc0686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d579563b-53a7-471f-8466-e3b29cfc0686', 'volume_size': 1}
Jul 03 23:54:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:57 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60 1073741824" returned: 0 in 0.848s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:57 devstack sudo[92451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60
Jul 03 23:54:57 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:58 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60" returned: 0 in 0.661s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.313s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-469243085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d579563b-53a7-471f-8466-e3b29cfc0686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='940a05ab895d42b892b45f9496d98dfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:54:57Z,use_quota=True,user_id='0b4a2f695d5041da8516542ab49c7ad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Creating volume d579563b-53a7-471f-8466-e3b29cfc0686 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:54:58 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8216774f-edec-4397-a53b-8f84b479c989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833e1250-1620-463e-979e-e39e5bb2f99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:54:58 devstack sudo[92454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686 1073741824
Jul 03 23:54:58 devstack sudo[92454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:54:58 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Volume volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60 (a0a23403-c5c2-4f5e-a115-dcb5fe87cd60): created successfully
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833e1250-1620-463e-979e-e39e5bb2f99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:54:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Flow 'volume_create_manager' (75fb5ef6-745b-494c-a461-faa20b964190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:54:58 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-34b35268-31c8-4144-b490-b39f04d3dda2 req-b1baaf1a-08a5-496e-90a9-30429e7e7b5a tempest-VolumesSnapshotsTestJSON-1581488274 None] Created volume successfully.
Jul 03 23:54:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:54:59 devstack sudo[92454]: pam_unix(sudo:session): session closed for user root
Jul 03 23:54:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686 1073741824" returned: 0 in 0.987s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:54:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:54:59 devstack sudo[92460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686
Jul 03 23:54:59 devstack sudo[92460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:00 devstack sudo[92460]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686" returned: 0 in 0.707s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.937s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=62,cinder:INSERT=16,cinder:UPDATE=84,cinder:DELETE=11 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aa0e51d-ac5e-42db-91fd-3ddebb0f021e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d579563b-53a7-471f-8466-e3b29cfc0686', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1503de7f-08e5-4c43-b333-21642a2032ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] Creating offline snapshot 93bc482d-db50-48a2-b800-32ae992bc762 of volume a0a23403-c5c2-4f5e-a115-dcb5fe87cd60 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:55:00 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Volume volume-d579563b-53a7-471f-8466-e3b29cfc0686 (d579563b-53a7-471f-8466-e3b29cfc0686): created successfully
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1503de7f-08e5-4c43-b333-21642a2032ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Flow 'volume_create_manager' (bb170a37-acc6-4296-bf6c-691dce1f9c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3804d12e-ca1e-4539-a4ce-5233576ccc5e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:00 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-b0ea877f-2dae-4e8c-950f-08a8e38ea65e tempest-SnapshotMetadataTestJSON-342045844 None] Created volume successfully.
Jul 03 23:55:00 devstack sudo[92463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60
Jul 03 23:55:00 devstack sudo[92463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Flow 'volume_create_manager' (cfd62ba3-fccd-4ad2-a378-5e17c12398a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3999ff58-83a3-4950-9d22-f272af35172a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3999ff58-83a3-4950-9d22-f272af35172a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1715785664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc49344-4e95-4900-8701-758cb54ffc1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f7420cf7444f0ebf8776f635192182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:01Z,use_quota=True,user_id='742dfd6c566d4e50a3626e01e3212151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabd33d5-b3a7-4029-993a-58e4c19553f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aabd33d5-b3a7-4029-993a-58e4c19553f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ebbccb-0b0f-4360-98df-90e96a47155f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ebbccb-0b0f-4360-98df-90e96a47155f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dc49344-4e95-4900-8701-758cb54ffc1c', 'volume_name': 'volume-4dc49344-4e95-4900-8701-758cb54ffc1c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df81c8c-fd7d-40c2-9d88-b3756d96df58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4df81c8c-fd7d-40c2-9d88-b3756d96df58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4187b86-904d-482e-8bc8-f5723a6fc15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:00 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Volume 4dc49344-4e95-4900-8701-758cb54ffc1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dc49344-4e95-4900-8701-758cb54ffc1c', 'volume_size': 1}
Jul 03 23:55:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:01 devstack sudo[92463]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60" returned: 0 in 0.851s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:01 devstack sudo[92468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762 1G
Jul 03 23:55:01 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:01 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=63,cinder:UPDATE=94,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:55:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:02 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762 1G" returned: 0 in 0.837s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:02 devstack sudo[92476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762
Jul 03 23:55:02 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:02 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762" returned: 0 in 0.773s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:02 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762 is being set with open permissions: ugo+rw
Jul 03 23:55:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:02 devstack sudo[92481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762
Jul 03 23:55:02 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:03 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762" returned: 0 in 0.763s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:03 devstack sudo[92485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.info
Jul 03 23:55:03 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:04 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.info" returned: 0 in 0.694s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:04 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.info is being set with open permissions: ugo+rw
Jul 03 23:55:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:04 devstack sudo[92488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.info
Jul 03 23:55:04 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:05 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.info" returned: 0 in 0.748s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.808s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.300s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1715785664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc49344-4e95-4900-8701-758cb54ffc1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3f7420cf7444f0ebf8776f635192182',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:01Z,use_quota=True,user_id='742dfd6c566d4e50a3626e01e3212151',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Creating volume 4dc49344-4e95-4900-8701-758cb54ffc1c {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:05 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:55:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4dc49344-4e95-4900-8701-758cb54ffc1c 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:05 devstack sudo[92816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4dc49344-4e95-4900-8701-758cb54ffc1c 1073741824
Jul 03 23:55:05 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:05 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-bfa1e885-9efd-4444-b00f-27bc92a6e896 req-518c0bfd-fbdd-4e5c-86b4-bea8cc55944e tempest-VolumesSnapshotsTestJSON-1581488274 None] Create snapshot completed successfully
Jul 03 23:55:06 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4dc49344-4e95-4900-8701-758cb54ffc1c 1073741824" returned: 0 in 0.951s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4dc49344-4e95-4900-8701-758cb54ffc1c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:06 devstack sudo[92838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4dc49344-4e95-4900-8701-758cb54ffc1c
Jul 03 23:55:06 devstack sudo[92838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Acquiring lock "cinder-93bc482d-db50-48a2-b800-32ae992bc762-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "cinder-93bc482d-db50-48a2-b800-32ae992bc762-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Acquiring lock "cinder-quobyte-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "cinder-quobyte-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Acquiring lock "cinder-quobyte-93bc482d-db50-48a2-b800-32ae992bc762" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "cinder-quobyte-93bc482d-db50-48a2-b800-32ae992bc762" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Deleting offline snapshot 93bc482d-db50-48a2-b800-32ae992bc762 of volume a0a23403-c5c2-4f5e-a115-dcb5fe87cd60 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] snapshot_file for this snap is: volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[806a492c-f654-4f51-b809-dfce3f0d7ced]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:06 devstack sudo[92843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762
Jul 03 23:55:06 devstack sudo[92843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:06 devstack sudo[92838]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4dc49344-4e95-4900-8701-758cb54ffc1c" returned: 0 in 0.746s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.285s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] Creating offline snapshot 3fdb70e3-e679-4c2c-97b9-5b0771431ee7 of volume d579563b-53a7-471f-8466-e3b29cfc0686 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4187b86-904d-482e-8bc8-f5723a6fc15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dc49344-4e95-4900-8701-758cb54ffc1c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcacbe9-ffaf-4480-a00b-42be27ec9bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[84285a5c-49e5-4730-b672-6ff751d6a1f3]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:06 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Volume volume-4dc49344-4e95-4900-8701-758cb54ffc1c (4dc49344-4e95-4900-8701-758cb54ffc1c): created successfully
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bcacbe9-ffaf-4480-a00b-42be27ec9bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Flow 'volume_create_manager' (cfd62ba3-fccd-4ad2-a378-5e17c12398a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:06 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-b6786f02-1a5d-44ba-877f-cbfe840bc546 tempest-AttachVolumeTestJSON-383063172 None] Created volume successfully.
Jul 03 23:55:07 devstack sudo[92846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686
Jul 03 23:55:07 devstack sudo[92846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:07 devstack sudo[92843]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762" returned: 0 in 0.831s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:55:07 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e1695c-d8c2-4f35-abfd-cf6ae1b1fda8]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:07 devstack sudo[92851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60
Jul 03 23:55:07 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:07 devstack sudo[92846]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686" returned: 0 in 0.973s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:07 devstack sudo[92858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7 1G
Jul 03 23:55:07 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:08 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Flow 'volume_create_manager' (152d9561-345c-4d89-a6e1-64fd43c91d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:08 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c3c028-b9bf-4155-9067-f1d13b013fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60" returned: 0 in 1.013s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c3c028-b9bf-4155-9067-f1d13b013fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1375292463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce444b2-f051-44a5-9283-6ea0e2968666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01be155b69f4e2b94767c4355015c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:08Z,use_quota=True,user_id='167254148f574598ac53d84e75ada077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e0c49a-0ea4-40d2-acd7-d43443205224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e0c49a-0ea4-40d2-acd7-d43443205224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:08 devstack sudo[92864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762
Jul 03 23:55:08 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab19aca-6d24-4a47-86f8-19a545eebb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab19aca-6d24-4a47-86f8-19a545eebb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ce444b2-f051-44a5-9283-6ea0e2968666', 'volume_name': 'volume-4ce444b2-f051-44a5-9283-6ea0e2968666', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b313600d-94cb-45cb-9314-2eba4e762fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b313600d-94cb-45cb-9314-2eba4e762fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89fd3bf-b055-4c43-8175-2e92245301c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:08 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Volume 4ce444b2-f051-44a5-9283-6ea0e2968666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ce444b2-f051-44a5-9283-6ea0e2968666', 'volume_size': 1}
Jul 03 23:55:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:08 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7 1G" returned: 0 in 0.910s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d579563b-53a7-471f-8466-e3b29cfc0686 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:08 devstack sudo[92874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d579563b-53a7-471f-8466-e3b29cfc0686 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7
Jul 03 23:55:08 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:09 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762" returned: 0 in 0.893s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:09 devstack sudo[92881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762
Jul 03 23:55:09 devstack sudo[92881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:09 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d579563b-53a7-471f-8466-e3b29cfc0686 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7" returned: 0 in 0.795s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:09 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7 is being set with open permissions: ugo+rw
Jul 03 23:55:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:09 devstack sudo[92887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7
Jul 03 23:55:09 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:09 devstack sudo[92881]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60.93bc482d-db50-48a2-b800-32ae992bc762" returned: 0 in 0.687s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "cinder-quobyte-93bc482d-db50-48a2-b800-32ae992bc762" released by "_delete_snapshot" :: held 3.561s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "cinder-quobyte-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60" released by "delete_snapshot" :: held 3.592s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:09 devstack cinder-volume[86650]: WARNING cinder.quota [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:55:09 devstack cinder-volume[86650]: DEBUG cinder.quota [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Created reservations ['bb464886-8786-46bb-8309-5a37b1db7cf6', '1011043f-8407-489c-b3a7-b30cce5becb6', '31f55c3d-3e4c-4a0a-a7ba-4fbeb77ce233', '8eeb6a75-02c3-42e8-b877-cb34b552e187'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:09 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Delete snapshot completed successfully.
Jul 03 23:55:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-3087061f-fd5a-45fa-932c-5e7cce284f2e req-ea57d3fc-4295-493a-aa21-c4b0e9c8e979 tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "cinder-93bc482d-db50-48a2-b800-32ae992bc762-delete_snapshot" released by "delete_snapshot" :: held 3.757s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:10 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7" returned: 0 in 0.735s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:10 devstack sudo[92891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.info
Jul 03 23:55:10 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Acquiring lock "cinder-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "cinder-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Acquiring lock "cinder-quobyte-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "cinder-quobyte-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60" acquired by "delete_volume" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:10 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d0cdd4-7839-4742-8931-42cf396d0c1b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:10 devstack sudo[92894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60
Jul 03 23:55:10 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:11 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.info" returned: 0 in 0.750s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:11 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.info is being set with open permissions: ugo+rw
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:11 devstack sudo[92903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.info
Jul 03 23:55:11 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-97c8f63e-c1de-4877-95c0-8828d0165169 req-8769c38a-079d-4ef1-b59e-3797b3913e65 tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:11 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60" returned: 0 in 0.895s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:11 devstack sudo[92911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60
Jul 03 23:55:11 devstack sudo[92911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:11 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.info" returned: 0 in 0.667s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.945s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.589s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1375292463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ce444b2-f051-44a5-9283-6ea0e2968666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f01be155b69f4e2b94767c4355015c46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:08Z,use_quota=True,user_id='167254148f574598ac53d84e75ada077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Creating volume 4ce444b2-f051-44a5-9283-6ea0e2968666 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:11 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:55:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4ce444b2-f051-44a5-9283-6ea0e2968666 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:11 devstack sudo[92913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4ce444b2-f051-44a5-9283-6ea0e2968666 1073741824
Jul 03 23:55:11 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:11 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f919eace-3db9-4722-bcd7-d5b967f26870 tempest-SnapshotMetadataTestJSON-342045844 None] Create snapshot completed successfully
Jul 03 23:55:12 devstack sudo[92911]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60" returned: 0 in 0.826s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "cinder-quobyte-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60" released by "delete_volume" :: held 1.789s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG cinder.quota [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Created reservations ['ba6f4bde-566b-4bed-ae6d-20ce91e84a26', '5a41be94-105f-482c-b28f-820ea97bd4d8', '60a634be-832f-4d38-a03e-5b8f8ff6b1bd', '1db77df5-d0c1-4619-9926-e118f7b8cda0'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:12 devstack sudo[92920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:55:12 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Acquiring lock "cinder-3fdb70e3-e679-4c2c-97b9-5b0771431ee7-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Lock "cinder-3fdb70e3-e679-4c2c-97b9-5b0771431ee7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Acquiring lock "cinder-quobyte-d579563b-53a7-471f-8466-e3b29cfc0686" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Lock "cinder-quobyte-d579563b-53a7-471f-8466-e3b29cfc0686" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Acquiring lock "cinder-quobyte-3fdb70e3-e679-4c2c-97b9-5b0771431ee7" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Lock "cinder-quobyte-3fdb70e3-e679-4c2c-97b9-5b0771431ee7" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Deleting offline snapshot 3fdb70e3-e679-4c2c-97b9-5b0771431ee7 of volume d579563b-53a7-471f-8466-e3b29cfc0686 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] snapshot_file for this snap is: volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:55:12 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4ce444b2-f051-44a5-9283-6ea0e2968666 1073741824" returned: 0 in 1.160s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d13ec0-50c6-4d34-b7aa-5bb63065c733]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4ce444b2-f051-44a5-9283-6ea0e2968666 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:13 devstack sudo[92924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4ce444b2-f051-44a5-9283-6ea0e2968666
Jul 03 23:55:13 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:13 devstack sudo[92923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7
Jul 03 23:55:13 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:13 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.862s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG cinder.manager [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:13 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Deleted volume successfully.
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-20c7823d-ee5a-47fb-b306-99e63b0523df req-cced465c-caae-4c5d-a811-f930157726f7 tempest-VolumesSnapshotsTestJSON-1581488274 None] Lock "cinder-a0a23403-c5c2-4f5e-a115-dcb5fe87cd60-delete_volume" released by "delete_volume" :: held 2.933s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:13 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4ce444b2-f051-44a5-9283-6ea0e2968666" returned: 0 in 0.837s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-97c8f63e-c1de-4877-95c0-8828d0165169 req-8769c38a-079d-4ef1-b59e-3797b3913e65 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.618s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89fd3bf-b055-4c43-8175-2e92245301c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ce444b2-f051-44a5-9283-6ea0e2968666', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:13 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2580bd2b-6cab-4063-a1b9-38b64752a3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f5869f-271c-459a-bdd4-5f8cbbbbebe6]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-97c8f63e-c1de-4877-95c0-8828d0165169 req-8769c38a-079d-4ef1-b59e-3797b3913e65 tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4dc49344-4e95-4900-8701-758cb54ffc1c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7" returned: 0 in 0.950s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d579563b-53a7-471f-8466-e3b29cfc0686(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:55:13 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Volume volume-4ce444b2-f051-44a5-9283-6ea0e2968666 (4ce444b2-f051-44a5-9283-6ea0e2968666): created successfully
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2580bd2b-6cab-4063-a1b9-38b64752a3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Flow 'volume_create_manager' (152d9561-345c-4d89-a6e1-64fd43c91d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[798092e9-3f6a-442b-91ee-46bf54534b60]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:13 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-a5a27d11-5686-42bf-b5c6-38905f0bc9f7 tempest-AttachVolumeShelveTestJSON-944900227 None] Created volume successfully.
Jul 03 23:55:14 devstack sudo[92932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4dc49344-4e95-4900-8701-758cb54ffc1c
Jul 03 23:55:14 devstack sudo[92932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:14 devstack sudo[92933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686
Jul 03 23:55:14 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:55:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:14 devstack sudo[92938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:55:14 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686" returned: 0 in 0.988s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:14 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:14 devstack sudo[92949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7
Jul 03 23:55:14 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:15 devstack sudo[92932]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-97c8f63e-c1de-4877-95c0-8828d0165169 req-8769c38a-079d-4ef1-b59e-3797b3913e65 tempest-AttachVolumeTestJSON-383063172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4dc49344-4e95-4900-8701-758cb54ffc1c" returned: 0 in 1.099s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-97c8f63e-c1de-4877-95c0-8828d0165169 req-8769c38a-079d-4ef1-b59e-3797b3913e65 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.136s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-97c8f63e-c1de-4877-95c0-8828d0165169 req-8769c38a-079d-4ef1-b59e-3797b3913e65 tempest-AttachVolumeTestJSON-383063172 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-4dc49344-4e95-4900-8701-758cb54ffc1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5519811f-cdd5-43ff-b311-058d78cbb054', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:55:15 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-97c8f63e-c1de-4877-95c0-8828d0165169 req-8769c38a-079d-4ef1-b59e-3797b3913e65 tempest-AttachVolumeTestJSON-383063172 None] attachment_update completed successfully.
Jul 03 23:55:15 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.096s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:55:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 8 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:55:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:55:16 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7" returned: 0 in 1.156s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:16 devstack sudo[93070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7
Jul 03 23:55:16 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:16 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686.3fdb70e3-e679-4c2c-97b9-5b0771431ee7" returned: 0 in 0.788s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Lock "cinder-quobyte-3fdb70e3-e679-4c2c-97b9-5b0771431ee7" released by "_delete_snapshot" :: held 4.043s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Lock "cinder-quobyte-d579563b-53a7-471f-8466-e3b29cfc0686" released by "delete_snapshot" :: held 4.097s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Created reservations ['38d35b15-901c-4755-bc56-6744be56914b', 'd752fa1a-d243-46f3-b167-972ef57f0323', 'b3dbe7cf-a819-4d5e-9514-46e6a8276d17', '2e44f4d5-fff4-4a6e-b89f-18c79aa6fa6b'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:17 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Delete snapshot completed successfully.
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-be923e34-5453-4f5b-a871-69a097a270a5 tempest-SnapshotMetadataTestJSON-342045844 None] Lock "cinder-3fdb70e3-e679-4c2c-97b9-5b0771431ee7-delete_snapshot" released by "delete_snapshot" :: held 4.259s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Flow 'volume_create_manager' (185bc81c-3f6c-4751-85bb-66bbbc5a0a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c09c95-2070-4b31-9f95-30ee6154cf5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c09c95-2070-4b31-9f95-30ee6154cf5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-573633394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea053d58-bcaf-4c43-8b90-92e57fb5e763,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da63da018a2d4bfc9fdcbfddd7b0b75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:18Z,use_quota=True,user_id='ab3ecb560f0c4aa0a6d4bbd96ffbaaa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3109c390-2f2d-4467-a57d-a5ecb35db0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3109c390-2f2d-4467-a57d-a5ecb35db0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65223cc0-bbfb-4f41-87bc-596bd81225b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65223cc0-bbfb-4f41-87bc-596bd81225b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea053d58-bcaf-4c43-8b90-92e57fb5e763', 'volume_name': 'volume-ea053d58-bcaf-4c43-8b90-92e57fb5e763', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45e952c-b01b-4ddb-910a-208b6cbf8ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45e952c-b01b-4ddb-910a-208b6cbf8ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb95b7e-f4a6-4a05-b9d6-6c3b78cc6f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:17 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Volume ea053d58-bcaf-4c43-8b90-92e57fb5e763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea053d58-bcaf-4c43-8b90-92e57fb5e763', 'volume_size': 1}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-573633394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea053d58-bcaf-4c43-8b90-92e57fb5e763,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='da63da018a2d4bfc9fdcbfddd7b0b75d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:18Z,use_quota=True,user_id='ab3ecb560f0c4aa0a6d4bbd96ffbaaa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Creating volume ea053d58-bcaf-4c43-8b90-92e57fb5e763 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:17 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:55:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ea053d58-bcaf-4c43-8b90-92e57fb5e763 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:17 devstack sudo[93078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ea053d58-bcaf-4c43-8b90-92e57fb5e763 1073741824
Jul 03 23:55:17 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Acquiring lock "cinder-d579563b-53a7-471f-8466-e3b29cfc0686-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Lock "cinder-d579563b-53a7-471f-8466-e3b29cfc0686-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Acquiring lock "cinder-quobyte-d579563b-53a7-471f-8466-e3b29cfc0686" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Lock "cinder-quobyte-d579563b-53a7-471f-8466-e3b29cfc0686" acquired by "delete_volume" :: waited 0.013s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:18 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9356082-3768-4456-b133-d54a46e75369]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:18 devstack sudo[93080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686
Jul 03 23:55:18 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:18 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ea053d58-bcaf-4c43-8b90-92e57fb5e763 1073741824" returned: 0 in 0.854s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ea053d58-bcaf-4c43-8b90-92e57fb5e763 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:18 devstack sudo[93085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ea053d58-bcaf-4c43-8b90-92e57fb5e763
Jul 03 23:55:18 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:19 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686" returned: 0 in 0.882s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:19 devstack sudo[93090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686
Jul 03 23:55:19 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:19 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ea053d58-bcaf-4c43-8b90-92e57fb5e763" returned: 0 in 0.727s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb95b7e-f4a6-4a05-b9d6-6c3b78cc6f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea053d58-bcaf-4c43-8b90-92e57fb5e763', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b285952-206f-4ad7-8b99-b862c62e075d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:19 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Volume volume-ea053d58-bcaf-4c43-8b90-92e57fb5e763 (ea053d58-bcaf-4c43-8b90-92e57fb5e763): created successfully
Jul 03 23:55:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b285952-206f-4ad7-8b99-b862c62e075d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Flow 'volume_create_manager' (185bc81c-3f6c-4751-85bb-66bbbc5a0a3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:19 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-93d8047d-79bc-4608-8926-07d83e8e63bb req-114c4cb3-1908-4963-abd4-cbc3975cc83d tempest-VolumesGetTestJSON-1675563145 None] Created volume successfully.
Jul 03 23:55:19 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d579563b-53a7-471f-8466-e3b29cfc0686" returned: 0 in 0.666s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Lock "cinder-quobyte-d579563b-53a7-471f-8466-e3b29cfc0686" released by "delete_volume" :: held 1.611s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:19 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Created reservations ['2d767109-b0af-4f46-9f2d-f93fa6fde019', '977d25bc-346f-48bb-b568-f4144fc39b15', '8edb944e-1d71-4266-915d-faa196fddc81', 'dffec259-e7fa-41fd-993e-7c0e427638cd'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:20 devstack sudo[93104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:55:20 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Acquiring lock "cinder-ea053d58-bcaf-4c43-8b90-92e57fb5e763-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Lock "cinder-ea053d58-bcaf-4c43-8b90-92e57fb5e763-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Acquiring lock "cinder-quobyte-ea053d58-bcaf-4c43-8b90-92e57fb5e763" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Lock "cinder-quobyte-ea053d58-bcaf-4c43-8b90-92e57fb5e763" acquired by "delete_volume" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:20 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef43a841-e60e-4314-a4cd-e90e12efadd9]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ea053d58-bcaf-4c43-8b90-92e57fb5e763 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:20 devstack sudo[93107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ea053d58-bcaf-4c43-8b90-92e57fb5e763
Jul 03 23:55:20 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:20 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.751s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:20 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:20 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Deleted volume successfully.
Jul 03 23:55:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f6a9c3a5-1d8c-4de4-b4b2-97c7e40aa443 tempest-SnapshotMetadataTestJSON-342045844 None] Lock "cinder-d579563b-53a7-471f-8466-e3b29cfc0686-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:21 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-d987b9e6-0ca4-4ad7-b615-1962d33e91f5 req-e2cf528f-5798-484b-a47e-de50320e12a5 tempest-AttachVolumeTestJSON-383063172 None] Terminate volume connection completed successfully.
Jul 03 23:55:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-d987b9e6-0ca4-4ad7-b615-1962d33e91f5 req-e2cf528f-5798-484b-a47e-de50320e12a5 tempest-AttachVolumeTestJSON-383063172 None] Deleting attachment 88bd9d81-dad0-4db1-a994-0b0402cf0ff2. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:55:21 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ea053d58-bcaf-4c43-8b90-92e57fb5e763" returned: 0 in 1.202s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ea053d58-bcaf-4c43-8b90-92e57fb5e763 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:21 devstack sudo[93115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ea053d58-bcaf-4c43-8b90-92e57fb5e763
Jul 03 23:55:21 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:22 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ea053d58-bcaf-4c43-8b90-92e57fb5e763" returned: 0 in 0.750s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Lock "cinder-quobyte-ea053d58-bcaf-4c43-8b90-92e57fb5e763" released by "delete_volume" :: held 2.013s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:22 devstack cinder-volume[86650]: DEBUG cinder.quota [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Created reservations ['474bab94-e6bd-4ea3-b951-db112548881e', 'c6eaff9b-638b-4952-857a-4e0fbf6eeb96', 'e3c1cb16-7d9d-458f-b368-e57cb2b70e86', '2bec14df-35c2-4fb3-9ed4-c7ec00d4ca76'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:22 devstack sudo[93118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:55:22 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:23 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.954s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:23 devstack cinder-volume[86650]: DEBUG cinder.manager [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:23 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Deleted volume successfully.
Jul 03 23:55:23 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-3231c4c6-af00-4e7a-a1ab-0d4f0207e5d2 req-a242ab61-fc2f-4c7b-baab-8ec7ef507f65 tempest-VolumesGetTestJSON-1675563145 None] Lock "cinder-ea053d58-bcaf-4c43-8b90-92e57fb5e763-delete_volume" released by "delete_volume" :: held 3.253s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:24 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-d3afb35a-8398-4aab-ab18-b667ceecdd66 req-4a14936f-45c4-4610-b9f1-9a57cb408657 tempest-AttachVolumeTestJSON-383063172 None] Terminate volume connection completed successfully.
Jul 03 23:55:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-d3afb35a-8398-4aab-ab18-b667ceecdd66 req-4a14936f-45c4-4610-b9f1-9a57cb408657 tempest-AttachVolumeTestJSON-383063172 None] Deleting attachment 5519811f-cdd5-43ff-b311-058d78cbb054. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Flow 'volume_create_manager' (859a5c0a-4484-4ab8-a410-c50376715682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c768ea-c3b7-400b-b44d-89d780365921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47c768ea-c3b7-400b-b44d-89d780365921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1617595806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7197a7d7-b092-4831-ada4-ad8315608d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1156d9295ae0473fb546f2706040516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:26Z,use_quota=True,user_id='def3e8fdba5a4af99323e857340ae6c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee5b797-314d-4bbc-b8d2-b1aae98b396f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee5b797-314d-4bbc-b8d2-b1aae98b396f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff59983-e95a-423b-b780-a945f0c60dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cff59983-e95a-423b-b780-a945f0c60dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7197a7d7-b092-4831-ada4-ad8315608d77', 'volume_name': 'volume-7197a7d7-b092-4831-ada4-ad8315608d77', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ebe750-74d0-46a5-b228-7cadda85ece7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0ebe750-74d0-46a5-b228-7cadda85ece7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a505de-ef36-4f6c-ae47-c73cbbda5983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:25 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Volume 7197a7d7-b092-4831-ada4-ad8315608d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7197a7d7-b092-4831-ada4-ad8315608d77', 'volume_size': 1}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1617595806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7197a7d7-b092-4831-ada4-ad8315608d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1156d9295ae0473fb546f2706040516a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:26Z,use_quota=True,user_id='def3e8fdba5a4af99323e857340ae6c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Creating volume 7197a7d7-b092-4831-ada4-ad8315608d77 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:25 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:55:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7197a7d7-b092-4831-ada4-ad8315608d77 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:25 devstack sudo[93126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7197a7d7-b092-4831-ada4-ad8315608d77 1073741824
Jul 03 23:55:25 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:26 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7197a7d7-b092-4831-ada4-ad8315608d77 1073741824" returned: 0 in 1.057s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7197a7d7-b092-4831-ada4-ad8315608d77 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:27 devstack sudo[93134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7197a7d7-b092-4831-ada4-ad8315608d77
Jul 03 23:55:27 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:27 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7197a7d7-b092-4831-ada4-ad8315608d77" returned: 0 in 0.925s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.049s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a505de-ef36-4f6c-ae47-c73cbbda5983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7197a7d7-b092-4831-ada4-ad8315608d77', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390daefe-6b11-4f37-a259-6eec8f9842a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:27 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Volume volume-7197a7d7-b092-4831-ada4-ad8315608d77 (7197a7d7-b092-4831-ada4-ad8315608d77): created successfully
Jul 03 23:55:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390daefe-6b11-4f37-a259-6eec8f9842a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Flow 'volume_create_manager' (859a5c0a-4484-4ab8-a410-c50376715682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:27 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7bc00588-b6ac-49f3-aa22-155d3de2688f tempest-AbsoluteLimitsTests-1173425196 None] Created volume successfully.
Jul 03 23:55:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Acquiring lock "cinder-7197a7d7-b092-4831-ada4-ad8315608d77-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Lock "cinder-7197a7d7-b092-4831-ada4-ad8315608d77-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Acquiring lock "cinder-quobyte-7197a7d7-b092-4831-ada4-ad8315608d77" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Lock "cinder-quobyte-7197a7d7-b092-4831-ada4-ad8315608d77" acquired by "delete_volume" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:29 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c7a619-5cec-4edd-aca2-d2dd6b8aaf9d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7197a7d7-b092-4831-ada4-ad8315608d77 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:29 devstack sudo[93174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7197a7d7-b092-4831-ada4-ad8315608d77
Jul 03 23:55:29 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:30 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7197a7d7-b092-4831-ada4-ad8315608d77" returned: 0 in 0.977s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7197a7d7-b092-4831-ada4-ad8315608d77 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:30 devstack sudo[93182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7197a7d7-b092-4831-ada4-ad8315608d77
Jul 03 23:55:30 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:31 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7197a7d7-b092-4831-ada4-ad8315608d77" returned: 0 in 0.894s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Lock "cinder-quobyte-7197a7d7-b092-4831-ada4-ad8315608d77" released by "delete_volume" :: held 1.932s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:31 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Created reservations ['86a1f1f8-7d3f-4bbc-bf52-53c7e075511c', '6463921e-d933-419d-b37b-c564203c0e7e', '313f1e71-384c-48e0-85dc-587ea2d5e5de', '8c7ab929-5ec4-4866-a2a0-52ca335d0d4d'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:31 devstack sudo[93186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:55:31 devstack sudo[93186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:32 devstack sudo[93186]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.081s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:32 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:32 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Deleted volume successfully.
Jul 03 23:55:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e21e435d-acc2-4e2a-ac01-9033c0409b58 tempest-AbsoluteLimitsTests-1173425196 None] Lock "cinder-7197a7d7-b092-4831-ada4-ad8315608d77-delete_volume" released by "delete_volume" :: held 3.303s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-43bda458-d16c-48a3-a202-2592ee2a001c req-8794d825-0dda-4be7-ac51-c443f64378d9 tempest-AttachVolumeShelveTestJSON-944900227 None] No connector for attachment 57f31ba9-d82b-46ca-a8e6-0b8fc7396c2c; skipping storage backend terminate_connection call. {{(pid=86650) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 03 23:55:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-43bda458-d16c-48a3-a202-2592ee2a001c req-8794d825-0dda-4be7-ac51-c443f64378d9 tempest-AttachVolumeShelveTestJSON-944900227 None] Deleting attachment 57f31ba9-d82b-46ca-a8e6-0b8fc7396c2c. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:55:35 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-14b5b28c-5b41-449d-a317-dbb1f050eb41 tempest-GroupsV314Test-774752979 None] Group tempest-GroupsV314Test-Group-700223826: creating
Jul 03 23:55:35 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-14b5b28c-5b41-449d-a317-dbb1f050eb41 tempest-GroupsV314Test-774752979 None] Group tempest-GroupsV314Test-Group-700223826: created successfully
Jul 03 23:55:35 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-14b5b28c-5b41-449d-a317-dbb1f050eb41 tempest-GroupsV314Test-774752979 None] Create group completed successfully.
Jul 03 23:55:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "cinder-4dc49344-4e95-4900-8701-758cb54ffc1c-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Lock "cinder-4dc49344-4e95-4900-8701-758cb54ffc1c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "cinder-quobyte-4dc49344-4e95-4900-8701-758cb54ffc1c" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Lock "cinder-quobyte-4dc49344-4e95-4900-8701-758cb54ffc1c" acquired by "delete_volume" :: waited 0.031s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:36 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc6ef3f-d7da-4cf0-b7d8-f92d8eb328cf]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4dc49344-4e95-4900-8701-758cb54ffc1c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:36 devstack sudo[93195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4dc49344-4e95-4900-8701-758cb54ffc1c
Jul 03 23:55:36 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:37 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4dc49344-4e95-4900-8701-758cb54ffc1c" returned: 0 in 0.890s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4dc49344-4e95-4900-8701-758cb54ffc1c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:37 devstack sudo[93201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4dc49344-4e95-4900-8701-758cb54ffc1c
Jul 03 23:55:37 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Flow 'volume_create_manager' (cceec6ea-f176-4483-9519-ac7f4c74a8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913ac2dd-7b29-47fd-ab8e-fc3165ebd4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913ac2dd-7b29-47fd-ab8e-fc3165ebd4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1000343977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f59d46d5-7107-404d-81a8-c0d30a885de2,host='devstack@QuobyteHD#QuobyteHD',id=a7ce41e2-53b1-473f-bae6-b33e3eb8358f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b8a048abf547aaa96530f8e5e712b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:37Z,use_quota=True,user_id='43171982f483493e8298505b350fee93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee59e592-6ac9-48f2-8c00-14e59eb9f2c4),volume_type_id=ee59e592-6ac9-48f2-8c00-14e59eb9f2c4)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ec827a-756d-4027-8e68-904ac53f7be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7ec827a-756d-4027-8e68-904ac53f7be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59734fa3-77fe-4cf4-894a-35e9687b8aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59734fa3-77fe-4cf4-894a-35e9687b8aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7ce41e2-53b1-473f-bae6-b33e3eb8358f', 'volume_name': 'volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b13e48-35e7-4d39-ba7f-c1c99252f15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b13e48-35e7-4d39-ba7f-c1c99252f15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2a5da7-af7d-43f3-99f8-f2f1ec7a7ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:37 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Volume a7ce41e2-53b1-473f-bae6-b33e3eb8358f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f', 'volume_size': 1}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f59d46d5-7107-404d-81a8-c0d30a885de2,created_at=2026-07-03T21:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1000343977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f59d46d5-7107-404d-81a8-c0d30a885de2,host='devstack@QuobyteHD#QuobyteHD',id=a7ce41e2-53b1-473f-bae6-b33e3eb8358f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8b8a048abf547aaa96530f8e5e712b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:37Z,use_quota=True,user_id='43171982f483493e8298505b350fee93',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ee59e592-6ac9-48f2-8c00-14e59eb9f2c4),volume_type_id=ee59e592-6ac9-48f2-8c00-14e59eb9f2c4)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Creating volume a7ce41e2-53b1-473f-bae6-b33e3eb8358f {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:37 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:37 devstack sudo[93203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f 1073741824
Jul 03 23:55:37 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Flow 'volume_create_manager' (ed1f7d12-d44a-442a-b38b-edd1cec3c31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcca2928-8962-4c68-9989-2ee0a43166f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcca2928-8962-4c68-9989-2ee0a43166f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-490030900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c87942-7b06-4090-91ed-30f64a79f852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c734b9ab1840da96640e4cfe047281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:38Z,use_quota=True,user_id='13d47ba046ed43f4959a68f5c6745b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a4fce7-17d1-400f-854a-824f04098c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a4fce7-17d1-400f-854a-824f04098c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deeb6dcd-a7db-43d2-aaf1-d6255895fff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deeb6dcd-a7db-43d2-aaf1-d6255895fff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c87942-7b06-4090-91ed-30f64a79f852', 'volume_name': 'volume-c3c87942-7b06-4090-91ed-30f64a79f852', 'volume_size': 2}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b974f8ed-40b9-4a5e-bdf8-72495143590c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b974f8ed-40b9-4a5e-bdf8-72495143590c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e51dbb-7443-49bf-83a0-c0f030efb449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:37 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Volume c3c87942-7b06-4090-91ed-30f64a79f852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c87942-7b06-4090-91ed-30f64a79f852', 'volume_size': 2}
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:37 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4dc49344-4e95-4900-8701-758cb54ffc1c" returned: 0 in 0.750s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Lock "cinder-quobyte-4dc49344-4e95-4900-8701-758cb54ffc1c" released by "delete_volume" :: held 1.684s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:38 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Created reservations ['047586c6-de2d-40f0-850d-9c86801d7097', 'b68d6c7f-4a96-4369-9935-67d81028562d', '53402b6f-4ca4-446f-8042-889139e912ee', '94ed2c5b-5c7a-43ab-a05c-c8a79e4370f9'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:38 devstack sudo[93210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:55:38 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:38 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f 1073741824" returned: 0 in 0.922s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:38 devstack sudo[93214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f
Jul 03 23:55:38 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "cinder-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Lock "cinder-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "cinder-quobyte-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Lock "cinder-quobyte-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:38 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[081e7a3f-2881-4910-8ecc-9a72371b6f2b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:38 devstack sudo[93216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4
Jul 03 23:55:38 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:39 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.888s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:39 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Deleted volume successfully.
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-164f0a25-4b94-4fda-8e1d-0bf4585bb344 tempest-AttachVolumeTestJSON-383063172 None] Lock "cinder-4dc49344-4e95-4900-8701-758cb54ffc1c-delete_volume" released by "delete_volume" :: held 2.840s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:39 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f" returned: 0 in 0.758s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.515s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-490030900',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c87942-7b06-4090-91ed-30f64a79f852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8c734b9ab1840da96640e4cfe047281',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:38Z,use_quota=True,user_id='13d47ba046ed43f4959a68f5c6745b37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Creating volume c3c87942-7b06-4090-91ed-30f64a79f852 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:55:39 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c3c87942-7b06-4090-91ed-30f64a79f852 2147483648 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:39 devstack sudo[93220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c3c87942-7b06-4090-91ed-30f64a79f852 2147483648
Jul 03 23:55:39 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d2a5da7-af7d-43f3-99f8-f2f1ec7a7ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6fecfe-3933-4d04-90d0-48f5b8d27835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:39 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Volume volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f (a7ce41e2-53b1-473f-bae6-b33e3eb8358f): created successfully
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6fecfe-3933-4d04-90d0-48f5b8d27835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Flow 'volume_create_manager' (cceec6ea-f176-4483-9519-ac7f4c74a8b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:39 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-40149208-3ddd-4919-94cf-a149f4efbe25 tempest-GroupsV314Test-774752979 None] Created volume successfully.
Jul 03 23:55:39 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4" returned: 0 in 0.848s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:39 devstack sudo[93225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4
Jul 03 23:55:39 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:40 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4" returned: 0 in 0.828s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Lock "cinder-quobyte-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4" released by "delete_volume" :: held 1.748s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:40 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c3c87942-7b06-4090-91ed-30f64a79f852 2147483648" returned: 0 in 1.216s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c3c87942-7b06-4090-91ed-30f64a79f852 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:40 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Created reservations ['140ac0a4-e5f8-464b-87fb-2007c4ab924f', 'b21d1398-4733-4072-b74d-7f3791455470', '5daefeb5-d8c4-41fc-b6ab-909dabd16256', 'f3238cfc-fc6a-4238-ba4f-4e62c00997f0'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:40 devstack sudo[93265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c3c87942-7b06-4090-91ed-30f64a79f852
Jul 03 23:55:40 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:40 devstack sudo[93269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:55:40 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "cinder-d8f03f4f-a817-42f5-8c42-219c31fd174b-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Lock "cinder-d8f03f4f-a817-42f5-8c42-219c31fd174b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "cinder-quobyte-d8f03f4f-a817-42f5-8c42-219c31fd174b" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Lock "cinder-quobyte-d8f03f4f-a817-42f5-8c42-219c31fd174b" acquired by "delete_volume" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f727cd28-aa2f-4a85-844c-c4c29a723600]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d8f03f4f-a817-42f5-8c42-219c31fd174b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:41 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c3c87942-7b06-4090-91ed-30f64a79f852" returned: 0 in 0.885s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.379s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:41 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Cloning volume a7ce41e2-53b1-473f-bae6-b33e3eb8358f to volume 3ba2f8fe-0434-45b6-8bd2-de70a4d6202d
Jul 03 23:55:41 devstack sudo[93271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d8f03f4f-a817-42f5-8c42-219c31fd174b
Jul 03 23:55:41 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e51dbb-7443-49bf-83a0-c0f030efb449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c87942-7b06-4090-91ed-30f64a79f852', 'volume_size': 2}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c991cdc-bbe9-41c3-b90b-37d0ee55e98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:41 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Volume volume-c3c87942-7b06-4090-91ed-30f64a79f852 (c3c87942-7b06-4090-91ed-30f64a79f852): created successfully
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c991cdc-bbe9-41c3-b90b-37d0ee55e98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Flow 'volume_create_manager' (ed1f7d12-d44a-442a-b38b-edd1cec3c31b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Creating offline snapshot 79f95db3-590b-45ff-b794-0218b7a194ce of volume a7ce41e2-53b1-473f-bae6-b33e3eb8358f {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:55:41 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-97521080-b9e9-4b9e-a5bc-758156b73add tempest-VolumesCloneNegativeTest-1002028713 None] Created volume successfully.
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef5ba33-5f7a-4532-9008-e86bbf759791]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:41 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.878s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:41 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Deleted volume successfully.
Jul 03 23:55:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e2d35061-3d26-4444-9f06-9a340a953317 tempest-AttachVolumeTestJSON-383063172 None] Lock "cinder-aa5a85c3-d4a3-4d7c-a7d5-0aea7d0f78d4-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:41 devstack sudo[93275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f
Jul 03 23:55:41 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Acquiring lock "cinder-c3c87942-7b06-4090-91ed-30f64a79f852-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Lock "cinder-c3c87942-7b06-4090-91ed-30f64a79f852-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Acquiring lock "cinder-quobyte-c3c87942-7b06-4090-91ed-30f64a79f852" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d8f03f4f-a817-42f5-8c42-219c31fd174b" returned: 0 in 1.003s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:42 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d8f03f4f-a817-42f5-8c42-219c31fd174b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Lock "cinder-quobyte-c3c87942-7b06-4090-91ed-30f64a79f852" acquired by "delete_volume" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:42 devstack sudo[93281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d8f03f4f-a817-42f5-8c42-219c31fd174b
Jul 03 23:55:42 devstack sudo[93281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:42 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[127274ab-b80e-4db0-8a9d-5a3fa8c2c6b1]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c3c87942-7b06-4090-91ed-30f64a79f852 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:42 devstack sudo[93283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c3c87942-7b06-4090-91ed-30f64a79f852
Jul 03 23:55:42 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:42 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f" returned: 0 in 1.047s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:42 devstack sudo[93289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce 1G
Jul 03 23:55:42 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:43 devstack sudo[93281]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d8f03f4f-a817-42f5-8c42-219c31fd174b" returned: 0 in 0.907s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Lock "cinder-quobyte-d8f03f4f-a817-42f5-8c42-219c31fd174b" released by "delete_volume" :: held 1.973s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:43 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:43 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Created reservations ['a2e831cc-6870-4c83-8f6f-6f1161dfdc07', '36e33556-3734-492b-9182-12aa1f614017', 'b8d95c49-bbf1-468c-bc23-fabdda32696a', '09810d41-3991-4280-b5c3-80702502c148'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c3c87942-7b06-4090-91ed-30f64a79f852" returned: 0 in 1.008s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c3c87942-7b06-4090-91ed-30f64a79f852 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:43 devstack sudo[93297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c3c87942-7b06-4090-91ed-30f64a79f852
Jul 03 23:55:43 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:43 devstack sudo[93302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:55:43 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:43 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce 1G" returned: 0 in 1.207s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:43 devstack sudo[93304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce
Jul 03 23:55:43 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:44 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c3c87942-7b06-4090-91ed-30f64a79f852" returned: 0 in 1.109s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Lock "cinder-quobyte-c3c87942-7b06-4090-91ed-30f64a79f852" released by "delete_volume" :: held 2.189s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:44 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.056s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:44 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Deleted volume successfully.
Jul 03 23:55:44 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Created reservations ['09abdc68-0283-4010-9b16-6a33d842b9d2', 'f5de0b38-950e-4707-8a47-b98b17098770', 'c87eac29-8983-4910-b4f8-307580122f6e', 'e8eecc62-fcba-49bb-8af3-7dbd0788a4c9'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:55:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b33ff4be-93d1-4b3c-ac49-1ed1b9321b3b tempest-AttachVolumeTestJSON-383063172 None] Lock "cinder-d8f03f4f-a817-42f5-8c42-219c31fd174b-delete_volume" released by "delete_volume" :: held 3.417s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:44 devstack sudo[93316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:55:44 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:44 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce" returned: 0 in 0.918s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:44 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:55:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:44 devstack sudo[93318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce
Jul 03 23:55:44 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:45 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.770s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:45 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:55:45 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Deleted volume successfully.
Jul 03 23:55:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a3524802-e1e8-491c-91e1-825fde9f5581 tempest-VolumesCloneNegativeTest-1002028713 None] Lock "cinder-c3c87942-7b06-4090-91ed-30f64a79f852-delete_volume" released by "delete_volume" :: held 3.303s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:55:45 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce" returned: 0 in 0.865s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:45 devstack sudo[93323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.info
Jul 03 23:55:45 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.info" returned: 0 in 0.861s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:46 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:55:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:46 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:46 devstack sudo[93326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.info
Jul 03 23:55:46 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:47 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.info" returned: 0 in 1.193s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:47 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Acquiring lock "cinder-quobyte-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d" by "_copy_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:55:47 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Lock "cinder-quobyte-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:55:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] snapshot: 79f95db3-590b-45ff-b794-0218b7a194ce, volume: 3ba2f8fe-0434-45b6-8bd2-de70a4d6202d,  {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 23:55:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:55:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:55:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:55:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:55:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:55:47 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b5fa76-f48d-44ac-aa4d-60a96fa743b7]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:48 devstack sudo[93329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce
Jul 03 23:55:48 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:49 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce" returned: 0 in 1.170s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:55:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] will copy from snapshot at /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 23:55:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Creating direct copy from snapshot {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 23:55:49 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b38d58-79bb-4930-a0cf-27820fe00e2a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:49 devstack sudo[93346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f
Jul 03 23:55:49 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f" returned: 0 in 1.054s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:50 devstack cinder-volume[86650]: DEBUG cinder.utils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Path /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d not found in is_blk_device check {{(pid=86650) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 23:55:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:50 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:50 devstack sudo[93368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d
Jul 03 23:55:50 devstack sudo[93368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:53 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:55:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Flow 'volume_create_manager' (aeb4327d-d232-4113-9700-a8194530c71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:55:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf02974-966d-4df3-9242-aef0e44f98e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baf02974-966d-4df3-9242-aef0e44f98e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-314786483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570c0994-1ea8-49ae-980e-2c708e1b8654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c569e631bd439582da51dfd50ddc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:53Z,use_quota=True,user_id='c5b7a919e1d74295a87ae5d172495932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4511459-3989-4a54-83be-6956463db606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4511459-3989-4a54-83be-6956463db606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56d1480-8fe7-4f37-822f-d8dc39eca297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:53 devstack cinder-volume[86650]: DEBUG cinder.image.glance [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Creating Keystone auth plugin from conf {{(pid=86650) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 23:55:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a56d1480-8fe7-4f37-822f-d8dc39eca297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '570c0994-1ea8-49ae-980e-2c708e1b8654', 'volume_name': 'volume-570c0994-1ea8-49ae-980e-2c708e1b8654', 'volume_size': 1, 'image_id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee7f20f7f01043bc91ea80a8d5f6c3f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'created_at': datetime.datetime(2026, 7, 3, 21, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 43, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000bb8a40>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aca78d6-f227-41a4-b3f6-a0073233aec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aca78d6-f227-41a4-b3f6-a0073233aec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:55:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4766556d-90dd-42f2-9428-ba56b1e084d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:55:55 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Volume 570c0994-1ea8-49ae-980e-2c708e1b8654: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-570c0994-1ea8-49ae-980e-2c708e1b8654', 'volume_size': 1, 'image_id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee7f20f7f01043bc91ea80a8d5f6c3f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'created_at': datetime.datetime(2026, 7, 3, 21, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 43, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000bb8a40>}
Jul 03 23:55:55 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Trying to clone 570c0994-1ea8-49ae-980e-2c708e1b8654 from image b8f0cc76-877f-40ea-bce4-db07a2ff6489 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}]). {{(pid=86650) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 23:55:56 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_py9jfwsddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 23:55:56 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Image download 20.69 MB at 20.69 MB/s
Jul 03 23:55:56 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e597f660-3235-4e26-9663-04f91dec8ef5]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_py9jfwsddevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:57 devstack sudo[93432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_py9jfwsddevstack@QuobyteHD
Jul 03 23:55:57 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:57 devstack sudo[93368]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d" returned: 0 in 7.423s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:57 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7f5437-f1e1-4ceb-8303-3ce88f265dbf]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:57 devstack sudo[93458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f
Jul 03 23:55:57 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:58 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_py9jfwsddevstack@QuobyteHD" returned: 0 in 1.429s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:58 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Temporary image b8f0cc76-877f-40ea-bce4-db07a2ff6489 is fetched for user c5b7a919e1d74295a87ae5d172495932. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 23:55:58 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65eeeac-5fa7-4f4a-8087-5deb279c8f03]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:55:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_py9jfwsddevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:58 devstack sudo[93475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_py9jfwsddevstack@QuobyteHD
Jul 03 23:55:58 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:59 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f" returned: 0 in 1.516s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:59 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Image conversion details: src /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f, size 1024.00 MB, duration 7.42 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 23:55:59 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Converted 1024.00 MB image at 137.92 MB/s
Jul 03 23:55:59 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:55:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:55:59 devstack sudo[93500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d
Jul 03 23:55:59 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:55:59 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root
Jul 03 23:55:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_py9jfwsddevstack@QuobyteHD" returned: 0 in 0.993s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:55:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:00 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d" returned: 0 in 0.893s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:00 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Lock "cinder-quobyte-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d" released by "_copy_volume_from_snapshot" :: held 12.245s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:00 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Acquiring lock "cinder-quobyte-79f95db3-590b-45ff-b794-0218b7a194ce" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:00 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Lock "cinder-quobyte-79f95db3-590b-45ff-b794-0218b7a194ce" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Deleting offline snapshot 79f95db3-590b-45ff-b794-0218b7a194ce of volume a7ce41e2-53b1-473f-bae6-b33e3eb8358f {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:56:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] snapshot_file for this snap is: volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:56:00 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7b076a-2806-42e1-b0bd-16feda2472ed]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:00 devstack sudo[93508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce
Jul 03 23:56:00 devstack sudo[93508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:01 devstack sudo[93508]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce" returned: 0 in 1.113s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:01 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e710c6e-2ca3-495e-a533-9a698223bb9a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:01 devstack sudo[93514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f
Jul 03 23:56:01 devstack sudo[93514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:02 devstack sudo[93514]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f" returned: 0 in 1.006s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:02 devstack sudo[93520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce
Jul 03 23:56:02 devstack sudo[93520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:03 devstack sudo[93520]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce" returned: 0 in 1.166s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:03 devstack sudo[93526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce
Jul 03 23:56:03 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:04 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f.79f95db3-590b-45ff-b794-0218b7a194ce" returned: 0 in 0.855s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Lock "cinder-quobyte-79f95db3-590b-45ff-b794-0218b7a194ce" released by "_delete_snapshot" :: held 4.341s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:04 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=88,cinder:UPDATE=96,cinder:DELETE=9,cinder:INSERT=27 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:56:04 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=84,cinder:INSERT=24,cinder:UPDATE=104,cinder:DELETE=7 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:56:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.014s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.147s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-314786483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570c0994-1ea8-49ae-980e-2c708e1b8654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c569e631bd439582da51dfd50ddc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:55:53Z,use_quota=True,user_id='c5b7a919e1d74295a87ae5d172495932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:56:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Creating volume 570c0994-1ea8-49ae-980e-2c708e1b8654 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:56:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:56:04 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:56:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:04 devstack sudo[93529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 1073741824
Jul 03 23:56:04 devstack sudo[93529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:04 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-cb69540a-144e-4ac4-b197-2f80c64a95f7 tempest-GroupsV314Test-774752979 None] Create group from source-group-f59d46d5-7107-404d-81a8-c0d30a885de2 completed successfully.
Jul 03 23:56:05 devstack sudo[93529]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 1073741824" returned: 0 in 1.115s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:05 devstack sudo[93536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654
Jul 03 23:56:05 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:06 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654" returned: 0 in 1.276s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] <== create_volume: return (2456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:56:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.459s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Acquiring lock "cinder-quobyte-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:06 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Attempting download of b8f0cc76-877f-40ea-bce4-db07a2ff6489 ((None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}])) to volume 570c0994-1ea8-49ae-980e-2c708e1b8654. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 23:56:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Lock "cinder-quobyte-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d" acquired by "delete_volume" :: waited 0.037s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:07 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b17e39a-8583-4dfc-87d3-f9ba9773fb1d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:07 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6fa6ff-08de-4635-be70-c9437e870328]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_k_rwlr9v {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:07 devstack sudo[93547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_k_rwlr9v
Jul 03 23:56:07 devstack sudo[93547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:07 devstack sudo[93546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d
Jul 03 23:56:07 devstack sudo[93546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:08 devstack sudo[93547]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_k_rwlr9v" returned: 0 in 1.154s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_k_rwlr9v {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:08 devstack sudo[93558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_k_rwlr9v
Jul 03 23:56:08 devstack sudo[93558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:08 devstack sudo[93546]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d" returned: 0 in 1.358s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:08 devstack sudo[93560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d
Jul 03 23:56:08 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:09 devstack sudo[93558]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_k_rwlr9v" returned: 1 in 0.947s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_k_rwlr9v' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:56:09 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58a4fbd-3545-4803-b444-8399acfb4a1a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_py9jfwsddevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:09 devstack sudo[93564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_py9jfwsddevstack@QuobyteHD
Jul 03 23:56:09 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:09 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d" returned: 0 in 1.220s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Lock "cinder-quobyte-3ba2f8fe-0434-45b6-8bd2-de70a4d6202d" released by "delete_volume" :: held 2.668s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:09 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Created reservations ['8ede101a-3ddb-455a-b52b-e8364f3aee0e'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:09 devstack cinder-volume[86650]: WARNING cinder.quota [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1739374003 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1739374003, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:56:09 devstack cinder-volume[86650]: WARNING cinder.quota [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1739374003 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1739374003, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:56:09 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Created reservations ['b194ac5a-c639-456d-a3df-4343abd6784e', '1707d674-92b6-48f6-83f8-5b288467290f', '2ff80f57-068c-414e-bb92-e609a8221825', '3d37ab1a-12db-41b6-b764-8e48ac641afa'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:10 devstack sudo[93570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:56:10 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:10 devstack sudo[93564]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_py9jfwsddevstack@QuobyteHD" returned: 0 in 1.035s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:10 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] b8f0cc76-877f-40ea-bce4-db07a2ff6489 was qcow2, converting to raw {{(pid=86650) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 23:56:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_py9jfwsddevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:10 devstack sudo[93572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_py9jfwsddevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654
Jul 03 23:56:10 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:10 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.832s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:10 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:56:10 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-53d43053-c4e3-4fb6-851e-90f8a66eb653 tempest-GroupsV314Test-774752979 None] Delete group completed successfully.
Jul 03 23:56:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] Acquiring lock "cinder-quobyte-a7ce41e2-53b1-473f-bae6-b33e3eb8358f" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] Lock "cinder-quobyte-a7ce41e2-53b1-473f-bae6-b33e3eb8358f" acquired by "delete_volume" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:11 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d537879-84d6-47c7-aa57-9b64fe1476ab]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:11 devstack sudo[93591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f
Jul 03 23:56:11 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:12 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f" returned: 0 in 1.380s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:12 devstack sudo[93598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f
Jul 03 23:56:12 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:13 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_py9jfwsddevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654" returned: 0 in 3.397s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:13 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_py9jfwsddevstack@QuobyteHD, size 112.00 MB, duration 3.40 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 23:56:13 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Converted 112.00 MB image at 32.96 MB/s
Jul 03 23:56:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:13 devstack sudo[93602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 1G
Jul 03 23:56:13 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:13 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7ce41e2-53b1-473f-bae6-b33e3eb8358f" returned: 0 in 0.780s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] Lock "cinder-quobyte-a7ce41e2-53b1-473f-bae6-b33e3eb8358f" released by "delete_volume" :: held 2.249s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:13 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] Created reservations ['44c8c6a6-04db-4800-b820-83fab35eea42'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:13 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] Created reservations ['6295dd14-6c1a-4604-83f4-77e2a279cdce', 'a7cfa902-d079-406f-8f04-4038a2cb8cdf', '529b167c-2df7-4d26-85d5-42f839ad669a', '227c9421-4641-4560-a94b-0096b2de0bc2'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:14 devstack sudo[93604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:56:14 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:56:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:14 devstack sudo[93608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:56:14 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:14 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 1G" returned: 0 in 1.103s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:14 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5080190-97cd-45f6-ba12-6e66ce74c526]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:14 devstack sudo[93611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654
Jul 03 23:56:14 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:15 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.025s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:56:15 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c3d95883-fa36-42f9-a9be-b84b52433aa9 tempest-GroupsV314Test-774752979 None] Delete group completed successfully.
Jul 03 23:56:15 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.035s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:56:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:56:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 28 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:56:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:56:15 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654" returned: 0 in 0.976s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:15 devstack sudo[93617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654
Jul 03 23:56:15 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:16 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654" returned: 1 in 0.978s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:56:16 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Downloaded image b8f0cc76-877f-40ea-bce4-db07a2ff6489 ((None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}])) to volume 570c0994-1ea8-49ae-980e-2c708e1b8654 successfully. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 23:56:16 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Temporary image b8f0cc76-877f-40ea-bce4-db07a2ff6489 for user c5b7a919e1d74295a87ae5d172495932 is deleted. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 23:56:16 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Marking volume 570c0994-1ea8-49ae-980e-2c708e1b8654 as bootable. {{(pid=86650) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 23:56:16 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Copying metadata from image b8f0cc76-877f-40ea-bce4-db07a2ff6489 to 570c0994-1ea8-49ae-980e-2c708e1b8654. {{(pid=86650) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 23:56:16 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Creating volume glance metadata for volume 570c0994-1ea8-49ae-980e-2c708e1b8654 backed by image b8f0cc76-877f-40ea-bce4-db07a2ff6489 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86650) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 23:56:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4766556d-90dd-42f2-9428-ba56b1e084d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-570c0994-1ea8-49ae-980e-2c708e1b8654', 'volume_size': 1, 'image_id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee7f20f7f01043bc91ea80a8d5f6c3f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'created_at': datetime.datetime(2026, 7, 3, 21, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 43, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000bb8a40>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a4545e-6b89-40eb-9acd-e6f801b5d817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:16 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Volume volume-570c0994-1ea8-49ae-980e-2c708e1b8654 (570c0994-1ea8-49ae-980e-2c708e1b8654): created successfully
Jul 03 23:56:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a4545e-6b89-40eb-9acd-e6f801b5d817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Flow 'volume_create_manager' (aeb4327d-d232-4113-9700-a8194530c71c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:16 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f8c8640d-1006-449a-824c-1311c403988d tempest-VolumesExtendTest-690854175 None] Created volume successfully.
Jul 03 23:56:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d2dd5635-50f6-4425-9972-586c4042a035 tempest-VolumesExtendTest-690854175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d2dd5635-50f6-4425-9972-586c4042a035 tempest-VolumesExtendTest-690854175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:17 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f78820-eb82-40cc-abcd-3c180e5bfb90]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2dd5635-50f6-4425-9972-586c4042a035 tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:18 devstack sudo[93626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654
Jul 03 23:56:18 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:18 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2dd5635-50f6-4425-9972-586c4042a035 tempest-VolumesExtendTest-690854175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654" returned: 0 in 1.050s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2dd5635-50f6-4425-9972-586c4042a035 tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:19 devstack sudo[93630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654
Jul 03 23:56:19 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:19 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2dd5635-50f6-4425-9972-586c4042a035 tempest-VolumesExtendTest-690854175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654" returned: 1 in 0.928s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2dd5635-50f6-4425-9972-586c4042a035 tempest-VolumesExtendTest-690854175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:56:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2dd5635-50f6-4425-9972-586c4042a035 tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 2G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2dd5635-50f6-4425-9972-586c4042a035 tempest-VolumesExtendTest-690854175 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 2G" returned: 0 in 0.097s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d2dd5635-50f6-4425-9972-586c4042a035 tempest-VolumesExtendTest-690854175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.148s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:20 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-d2dd5635-50f6-4425-9972-586c4042a035 tempest-VolumesExtendTest-690854175 None] Extend volume completed successfully.
Jul 03 23:56:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Acquiring lock "cinder-570c0994-1ea8-49ae-980e-2c708e1b8654-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Lock "cinder-570c0994-1ea8-49ae-980e-2c708e1b8654-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Acquiring lock "cinder-quobyte-570c0994-1ea8-49ae-980e-2c708e1b8654" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Lock "cinder-quobyte-570c0994-1ea8-49ae-980e-2c708e1b8654" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:20 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ae0b73-0dc3-4fc1-b5f2-12bc8d4195cb]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:20 devstack sudo[93639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654
Jul 03 23:56:20 devstack sudo[93639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:21 devstack sudo[93639]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654" returned: 0 in 0.792s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:21 devstack sudo[93643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654
Jul 03 23:56:21 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:21 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-185ba107-cfc2-4d11-ba74-e1a57c2142be tempest-GroupsV320Test-1174702173 None] Group tempest-GroupsV320Test-Group-1311550647: creating
Jul 03 23:56:21 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-185ba107-cfc2-4d11-ba74-e1a57c2142be tempest-GroupsV320Test-1174702173 None] Group tempest-GroupsV320Test-Group-1311550647: created successfully
Jul 03 23:56:21 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-185ba107-cfc2-4d11-ba74-e1a57c2142be tempest-GroupsV320Test-1174702173 None] Create group completed successfully.
Jul 03 23:56:22 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654" returned: 1 in 0.839s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:56:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:22 devstack sudo[93651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654
Jul 03 23:56:22 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:22 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-570c0994-1ea8-49ae-980e-2c708e1b8654" returned: 0 in 0.710s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Lock "cinder-quobyte-570c0994-1ea8-49ae-980e-2c708e1b8654" released by "delete_volume" :: held 2.412s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:22 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Created reservations ['77515745-2643-4249-be04-bb219015fe3c', '10311dd5-a852-44d5-9e92-ff15c6e4d2d0', 'f09644db-561e-4379-bbf9-116ec93d5e33', 'efad0bf1-5c9f-4f1a-9e48-07f6649ee874'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:23 devstack sudo[93655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:56:23 devstack sudo[93655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:23 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-87d3e887-3de0-41d6-9f0b-a2744f1d579b tempest-GroupsV320Test-1174702173 None] Created reservations ['b3d12993-4ddf-4f14-870a-3d6bf0860e83'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-87d3e887-3de0-41d6-9f0b-a2744f1d579b tempest-GroupsV320Test-1174702173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-87d3e887-3de0-41d6-9f0b-a2744f1d579b tempest-GroupsV320Test-1174702173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-87d3e887-3de0-41d6-9f0b-a2744f1d579b tempest-GroupsV320Test-1174702173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-87d3e887-3de0-41d6-9f0b-a2744f1d579b tempest-GroupsV320Test-1174702173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-87d3e887-3de0-41d6-9f0b-a2744f1d579b tempest-GroupsV320Test-1174702173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-87d3e887-3de0-41d6-9f0b-a2744f1d579b tempest-GroupsV320Test-1174702173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:23 devstack sudo[93663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:56:23 devstack sudo[93663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.225s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:24 devstack sudo[93655]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:24 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:56:24 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Deleted volume successfully.
Jul 03 23:56:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7fa155a5-9146-4dec-ab19-23d21b33b082 tempest-VolumesExtendTest-690854175 None] Lock "cinder-570c0994-1ea8-49ae-980e-2c708e1b8654-delete_volume" released by "delete_volume" :: held 3.931s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:24 devstack sudo[93663]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-87d3e887-3de0-41d6-9f0b-a2744f1d579b tempest-GroupsV320Test-1174702173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.466s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:24 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-87d3e887-3de0-41d6-9f0b-a2744f1d579b tempest-GroupsV320Test-1174702173 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:56:24 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-87d3e887-3de0-41d6-9f0b-a2744f1d579b tempest-GroupsV320Test-1174702173 None] Delete group completed successfully.
Jul 03 23:56:24 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:56:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Flow 'volume_create_manager' (a99947f3-3852-499f-bdf4-afbf73e421ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae897d33-df07-434d-a70f-695fcd1d4a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae897d33-df07-434d-a70f-695fcd1d4a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-838766364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cde97e0-92f2-462f-8370-6dc292cebd63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c569e631bd439582da51dfd50ddc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:25Z,use_quota=True,user_id='c5b7a919e1d74295a87ae5d172495932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e56e1a6-536f-46f3-94b9-b8ef8953adb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e56e1a6-536f-46f3-94b9-b8ef8953adb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec79650-b748-4537-80fc-c213e8cdf360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ec79650-b748-4537-80fc-c213e8cdf360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cde97e0-92f2-462f-8370-6dc292cebd63', 'volume_name': 'volume-9cde97e0-92f2-462f-8370-6dc292cebd63', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4c16ee-ba0e-4460-a941-5821f78786c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef4c16ee-ba0e-4460-a941-5821f78786c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68fca362-7b66-480c-92e6-97ea0444d09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:25 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Volume 9cde97e0-92f2-462f-8370-6dc292cebd63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cde97e0-92f2-462f-8370-6dc292cebd63', 'volume_size': 1}
Jul 03 23:56:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-838766364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cde97e0-92f2-462f-8370-6dc292cebd63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94c569e631bd439582da51dfd50ddc56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:25Z,use_quota=True,user_id='c5b7a919e1d74295a87ae5d172495932',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:56:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Creating volume 9cde97e0-92f2-462f-8370-6dc292cebd63 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:56:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:56:25 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:56:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:25 devstack sudo[93685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63 1073741824
Jul 03 23:56:25 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:26 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63 1073741824" returned: 0 in 1.468s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:26 devstack sudo[93711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63
Jul 03 23:56:26 devstack sudo[93711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:27 devstack sudo[93711]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63" returned: 0 in 0.859s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] <== create_volume: return (2395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:56:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.400s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68fca362-7b66-480c-92e6-97ea0444d09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cde97e0-92f2-462f-8370-6dc292cebd63', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7655028-b19b-4af4-a5db-32b11a100ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:27 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Volume volume-9cde97e0-92f2-462f-8370-6dc292cebd63 (9cde97e0-92f2-462f-8370-6dc292cebd63): created successfully
Jul 03 23:56:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7655028-b19b-4af4-a5db-32b11a100ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Flow 'volume_create_manager' (a99947f3-3852-499f-bdf4-afbf73e421ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:27 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-5064bdf3-d27a-442c-8927-9e69bb71d46d tempest-VolumesExtendTest-690854175 None] Created volume successfully.
Jul 03 23:56:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] Creating offline snapshot 55c1c9f2-774d-4e82-a251-3e1110534141 of volume 9cde97e0-92f2-462f-8370-6dc292cebd63 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:56:28 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d3bc3c-c49d-47dd-a597-af5e885aa17a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:28 devstack sudo[93715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63
Jul 03 23:56:28 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:29 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63" returned: 0 in 0.952s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:29 devstack sudo[93720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141 1G
Jul 03 23:56:29 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:30 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141 1G" returned: 0 in 1.322s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cde97e0-92f2-462f-8370-6dc292cebd63 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:30 devstack sudo[93767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cde97e0-92f2-462f-8370-6dc292cebd63 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141
Jul 03 23:56:30 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:31 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9cde97e0-92f2-462f-8370-6dc292cebd63 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141" returned: 0 in 0.987s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:31 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141 is being set with open permissions: ugo+rw
Jul 03 23:56:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Acquiring lock "cinder-4ce444b2-f051-44a5-9283-6ea0e2968666-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:31 devstack sudo[93788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141
Jul 03 23:56:31 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Lock "cinder-4ce444b2-f051-44a5-9283-6ea0e2968666-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Acquiring lock "cinder-quobyte-4ce444b2-f051-44a5-9283-6ea0e2968666" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Lock "cinder-quobyte-4ce444b2-f051-44a5-9283-6ea0e2968666" acquired by "delete_volume" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:31 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef85503-801e-47c3-9706-e414971a4c0a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4ce444b2-f051-44a5-9283-6ea0e2968666 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:31 devstack sudo[93800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4ce444b2-f051-44a5-9283-6ea0e2968666
Jul 03 23:56:31 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:32 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141" returned: 0 in 0.990s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:32 devstack sudo[93803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.info
Jul 03 23:56:32 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:32 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4ce444b2-f051-44a5-9283-6ea0e2968666" returned: 0 in 1.109s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4ce444b2-f051-44a5-9283-6ea0e2968666 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:32 devstack sudo[93810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4ce444b2-f051-44a5-9283-6ea0e2968666
Jul 03 23:56:32 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:33 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.info" returned: 0 in 1.071s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:33 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.info is being set with open permissions: ugo+rw
Jul 03 23:56:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:33 devstack sudo[93814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.info
Jul 03 23:56:33 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:33 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4ce444b2-f051-44a5-9283-6ea0e2968666" returned: 0 in 1.101s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Lock "cinder-quobyte-4ce444b2-f051-44a5-9283-6ea0e2968666" released by "delete_volume" :: held 2.327s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:34 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Created reservations ['fe8a1738-7e2c-4576-b460-ca029df2cbc0', 'c8403f8d-e7a5-4744-ad40-20d61734732a', '153e4c1e-ca50-4d5b-8dfa-f07a8ae0abf3', '03a035d9-ff63-49cf-8472-cb95ed387fb8'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:34 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:34 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:34 devstack sudo[93817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:56:34 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:34 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.info" returned: 0 in 1.096s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.540s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:34 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-17296ab7-8453-4405-8f41-e92e6717798c tempest-VolumesExtendTest-690854175 None] Create snapshot completed successfully
Jul 03 23:56:35 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.098s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:35 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:56:35 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Deleted volume successfully.
Jul 03 23:56:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3bf6be4a-b7ef-4f03-a9bd-d79d7be85f3f tempest-AttachVolumeShelveTestJSON-944900227 None] Lock "cinder-4ce444b2-f051-44a5-9283-6ea0e2968666-delete_volume" released by "delete_volume" :: held 3.784s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d7dcc44e-4770-4ff4-985a-625e9084f828 tempest-VolumesExtendTest-690854175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d7dcc44e-4770-4ff4-985a-625e9084f828 tempest-VolumesExtendTest-690854175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:35 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[05dba614-e69d-4aad-8a19-288dddb0387b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d7dcc44e-4770-4ff4-985a-625e9084f828 tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:36 devstack sudo[93822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63
Jul 03 23:56:36 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:37 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d7dcc44e-4770-4ff4-985a-625e9084f828 tempest-VolumesExtendTest-690854175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63" returned: 0 in 1.239s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d7dcc44e-4770-4ff4-985a-625e9084f828 tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141 2G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d7dcc44e-4770-4ff4-985a-625e9084f828 tempest-VolumesExtendTest-690854175 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141 2G" returned: 0 in 0.231s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d7dcc44e-4770-4ff4-985a-625e9084f828 tempest-VolumesExtendTest-690854175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.526s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:37 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-d7dcc44e-4770-4ff4-985a-625e9084f828 tempest-VolumesExtendTest-690854175 None] Extend volume completed successfully.
Jul 03 23:56:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Acquiring lock "cinder-55c1c9f2-774d-4e82-a251-3e1110534141-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Lock "cinder-55c1c9f2-774d-4e82-a251-3e1110534141-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Acquiring lock "cinder-quobyte-9cde97e0-92f2-462f-8370-6dc292cebd63" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Lock "cinder-quobyte-9cde97e0-92f2-462f-8370-6dc292cebd63" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Acquiring lock "cinder-quobyte-55c1c9f2-774d-4e82-a251-3e1110534141" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Lock "cinder-quobyte-55c1c9f2-774d-4e82-a251-3e1110534141" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Deleting offline snapshot 55c1c9f2-774d-4e82-a251-3e1110534141 of volume 9cde97e0-92f2-462f-8370-6dc292cebd63 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:56:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] snapshot_file for this snap is: volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:56:38 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b199345-17fb-4abf-9033-598c02d4854a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:38 devstack sudo[93837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141
Jul 03 23:56:38 devstack sudo[93837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:39 devstack sudo[93837]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141" returned: 0 in 1.372s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:39 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9cde97e0-92f2-462f-8370-6dc292cebd63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:56:39 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[695f49de-60e2-4695-8898-a95e3452747c]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:40 devstack sudo[93843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63
Jul 03 23:56:40 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:41 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63" returned: 0 in 1.175s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:41 devstack sudo[93862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141
Jul 03 23:56:41 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:42 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141" returned: 0 in 1.518s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:42 devstack sudo[93890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141
Jul 03 23:56:42 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:56:43 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Flow 'volume_create_manager' (311bf2f3-1b3b-4c3c-9edf-be4f9c62e902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0ceec6-335c-41b4-969e-601d8b15811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63.55c1c9f2-774d-4e82-a251-3e1110534141" returned: 0 in 0.893s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e0ceec6-335c-41b4-969e-601d8b15811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-923120849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e5018e-46e7-433a-bf7e-90d56b59ff6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d5e5c03f364c85a978b17e1bb1cb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:43Z,use_quota=True,user_id='d825678c4d434843bf0912ce78fabd38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd725267-77dd-4992-bb62-0088d7f08ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd725267-77dd-4992-bb62-0088d7f08ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1a8eb8-bf35-44db-97ff-ca54b4aaea2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d1a8eb8-bf35-44db-97ff-ca54b4aaea2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74e5018e-46e7-433a-bf7e-90d56b59ff6a', 'volume_name': 'volume-74e5018e-46e7-433a-bf7e-90d56b59ff6a', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8418226c-ecc9-447d-b1d9-f2777cb05484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8418226c-ecc9-447d-b1d9-f2777cb05484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396c2b7d-2e0a-4742-b90d-2b18464a4691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:43 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Volume 74e5018e-46e7-433a-bf7e-90d56b59ff6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74e5018e-46e7-433a-bf7e-90d56b59ff6a', 'volume_size': 1}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-923120849',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74e5018e-46e7-433a-bf7e-90d56b59ff6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4d5e5c03f364c85a978b17e1bb1cb24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:43Z,use_quota=True,user_id='d825678c4d434843bf0912ce78fabd38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Creating volume 74e5018e-46e7-433a-bf7e-90d56b59ff6a {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:56:43 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74e5018e-46e7-433a-bf7e-90d56b59ff6a 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:43 devstack sudo[93894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74e5018e-46e7-433a-bf7e-90d56b59ff6a 1073741824
Jul 03 23:56:43 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Lock "cinder-quobyte-55c1c9f2-774d-4e82-a251-3e1110534141" released by "_delete_snapshot" :: held 5.184s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Lock "cinder-quobyte-9cde97e0-92f2-462f-8370-6dc292cebd63" released by "delete_snapshot" :: held 5.228s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Created reservations ['422b5abb-d569-480b-bec1-7deb9ad9f3f4', '1f2c2777-43b2-4a30-a83e-74c9c8d956fa', '43bee88e-c98e-4a5f-83d3-b646c14def5a', '8ed2af19-5cc4-48af-85cc-209ce499a36b'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:43 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Delete snapshot completed successfully.
Jul 03 23:56:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-41414cb5-36c1-478b-955a-6f455976e487 tempest-VolumesExtendTest-690854175 None] Lock "cinder-55c1c9f2-774d-4e82-a251-3e1110534141-delete_snapshot" released by "delete_snapshot" :: held 5.465s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:44 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74e5018e-46e7-433a-bf7e-90d56b59ff6a 1073741824" returned: 0 in 1.011s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74e5018e-46e7-433a-bf7e-90d56b59ff6a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:44 devstack sudo[93900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74e5018e-46e7-433a-bf7e-90d56b59ff6a
Jul 03 23:56:44 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Acquiring lock "cinder-9cde97e0-92f2-462f-8370-6dc292cebd63-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Lock "cinder-9cde97e0-92f2-462f-8370-6dc292cebd63-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Acquiring lock "cinder-quobyte-9cde97e0-92f2-462f-8370-6dc292cebd63" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Lock "cinder-quobyte-9cde97e0-92f2-462f-8370-6dc292cebd63" acquired by "delete_volume" :: waited 0.028s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8366e43-ab82-40c5-8a5a-9532d2a5b487]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:45 devstack sudo[93902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63
Jul 03 23:56:45 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Flow 'volume_create_manager' (8c5cae65-49e1-4c13-8a27-bde8e62a9394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:45 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111a38d5-d569-42c2-ac3d-310b2aabd52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74e5018e-46e7-433a-bf7e-90d56b59ff6a" returned: 0 in 0.944s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.003s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (111a38d5-d569-42c2-ac3d-310b2aabd52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-104054451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf1c443-e586-4e14-89aa-d32f1027d514,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b511336b2de7475faaf9d47de239cd07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:45Z,use_quota=True,user_id='d4cdaf9d8aff45da9ee5abbad5c87868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcd6113-65e1-49ba-ac8f-1172093f9b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcd6113-65e1-49ba-ac8f-1172093f9b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd34621-f70b-4203-8440-73d6f57da3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd34621-f70b-4203-8440-73d6f57da3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccf1c443-e586-4e14-89aa-d32f1027d514', 'volume_name': 'volume-ccf1c443-e586-4e14-89aa-d32f1027d514', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d2e192-d74a-42c2-acf5-2649dd91c0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d2e192-d74a-42c2-acf5-2649dd91c0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430c6d42-0dc7-4eb7-aa21-26d7c5382724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:45 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Volume ccf1c443-e586-4e14-89aa-d32f1027d514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccf1c443-e586-4e14-89aa-d32f1027d514', 'volume_size': 1}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-104054451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf1c443-e586-4e14-89aa-d32f1027d514,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b511336b2de7475faaf9d47de239cd07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:45Z,use_quota=True,user_id='d4cdaf9d8aff45da9ee5abbad5c87868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Creating volume ccf1c443-e586-4e14-89aa-d32f1027d514 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:56:45 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccf1c443-e586-4e14-89aa-d32f1027d514 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (396c2b7d-2e0a-4742-b90d-2b18464a4691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74e5018e-46e7-433a-bf7e-90d56b59ff6a', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c73d2cf-72a9-4a92-956c-7db7c4927041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:45 devstack sudo[93921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccf1c443-e586-4e14-89aa-d32f1027d514 1073741824
Jul 03 23:56:45 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:45 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Volume volume-74e5018e-46e7-433a-bf7e-90d56b59ff6a (74e5018e-46e7-433a-bf7e-90d56b59ff6a): created successfully
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c73d2cf-72a9-4a92-956c-7db7c4927041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Flow 'volume_create_manager' (311bf2f3-1b3b-4c3c-9edf-be4f9c62e902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:45 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-11e5f5e8-fada-4f5f-af6b-d6223f32a0c7 tempest-VolumesServicesTestJSON-1241445105 None] Created volume successfully.
Jul 03 23:56:46 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63" returned: 0 in 1.025s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:46 devstack sudo[93926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63
Jul 03 23:56:46 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:46 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccf1c443-e586-4e14-89aa-d32f1027d514 1073741824" returned: 0 in 0.982s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccf1c443-e586-4e14-89aa-d32f1027d514 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:46 devstack sudo[93932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccf1c443-e586-4e14-89aa-d32f1027d514
Jul 03 23:56:46 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:46 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-9cde97e0-92f2-462f-8370-6dc292cebd63" returned: 0 in 0.688s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Lock "cinder-quobyte-9cde97e0-92f2-462f-8370-6dc292cebd63" released by "delete_volume" :: held 1.801s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Acquiring lock "cinder-74e5018e-46e7-433a-bf7e-90d56b59ff6a-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Lock "cinder-74e5018e-46e7-433a-bf7e-90d56b59ff6a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Acquiring lock "cinder-quobyte-74e5018e-46e7-433a-bf7e-90d56b59ff6a" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:46 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Created reservations ['c53c958d-2d43-4ea2-afa9-9845aba74b21', '6f03fd70-7ae0-45c5-a88c-8d7429f37a1e', '9058f6bd-ef2f-49d5-ae4c-9e1d7d0d3bd8', '0e20312d-b1ac-49b2-9a28-75bf6147b45b'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Lock "cinder-quobyte-74e5018e-46e7-433a-bf7e-90d56b59ff6a" acquired by "delete_volume" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:46 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[65867c01-ac9f-44a1-b144-247ad11afd7b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74e5018e-46e7-433a-bf7e-90d56b59ff6a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:47 devstack sudo[93936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:56:47 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:47 devstack sudo[93935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74e5018e-46e7-433a-bf7e-90d56b59ff6a
Jul 03 23:56:47 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:47 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccf1c443-e586-4e14-89aa-d32f1027d514" returned: 0 in 0.890s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430c6d42-0dc7-4eb7-aa21-26d7c5382724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf1c443-e586-4e14-89aa-d32f1027d514', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a64256-8731-4af5-a227-f012e6fb244a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:47 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Volume volume-ccf1c443-e586-4e14-89aa-d32f1027d514 (ccf1c443-e586-4e14-89aa-d32f1027d514): created successfully
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9a64256-8731-4af5-a227-f012e6fb244a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Flow 'volume_create_manager' (8c5cae65-49e1-4c13-8a27-bde8e62a9394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:47 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-293cd0af-fc82-41ba-a3f3-ecce449c24cf tempest-VolumesTestJSON-1731407762 None] Created volume successfully.
Jul 03 23:56:47 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.782s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:56:47 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Deleted volume successfully.
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1eb01207-b024-4577-aa2d-153c57184dcd tempest-VolumesExtendTest-690854175 None] Lock "cinder-9cde97e0-92f2-462f-8370-6dc292cebd63-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:47 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74e5018e-46e7-433a-bf7e-90d56b59ff6a" returned: 0 in 1.029s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74e5018e-46e7-433a-bf7e-90d56b59ff6a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:48 devstack sudo[93944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74e5018e-46e7-433a-bf7e-90d56b59ff6a
Jul 03 23:56:48 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:48 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74e5018e-46e7-433a-bf7e-90d56b59ff6a" returned: 0 in 0.732s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Lock "cinder-quobyte-74e5018e-46e7-433a-bf7e-90d56b59ff6a" released by "delete_volume" :: held 1.807s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:48 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Created reservations ['a72c1200-521f-4b47-bfc8-aeddb06ea8bc', '361950b8-4b43-45c7-8a93-e35fecb118ff', 'e1790c5e-0842-4686-8a89-5284afd63269', '40eb9c69-19c6-49d4-b614-898300a07e08'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:56:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:48 devstack sudo[93947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:56:48 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Flow 'volume_create_manager' (19ea77c2-dec4-479c-a203-e2597f0f50bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cc6551-3ee6-4f2d-a156-545e016a12f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cc6551-3ee6-4f2d-a156-545e016a12f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1424859862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740951a8-87da-4812-aa5f-c99652c2c00e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b511336b2de7475faaf9d47de239cd07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:49Z,use_quota=True,user_id='d4cdaf9d8aff45da9ee5abbad5c87868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e3ab80-30ca-45d3-be57-ade5080a0eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e3ab80-30ca-45d3-be57-ade5080a0eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d2b0e9-7aae-46d5-af9b-8de61592dc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d2b0e9-7aae-46d5-af9b-8de61592dc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '740951a8-87da-4812-aa5f-c99652c2c00e', 'volume_name': 'volume-740951a8-87da-4812-aa5f-c99652c2c00e', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55583148-c98c-44cf-88ff-1659839ccca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55583148-c98c-44cf-88ff-1659839ccca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55c126b-06d0-459d-a640-b85a814843a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:49 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Volume 740951a8-87da-4812-aa5f-c99652c2c00e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-740951a8-87da-4812-aa5f-c99652c2c00e', 'volume_size': 1}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1424859862',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740951a8-87da-4812-aa5f-c99652c2c00e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b511336b2de7475faaf9d47de239cd07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:49Z,use_quota=True,user_id='d4cdaf9d8aff45da9ee5abbad5c87868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Creating volume 740951a8-87da-4812-aa5f-c99652c2c00e {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:56:49 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-740951a8-87da-4812-aa5f-c99652c2c00e 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:49 devstack sudo[93949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-740951a8-87da-4812-aa5f-c99652c2c00e 1073741824
Jul 03 23:56:49 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:49 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.939s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:56:49 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Deleted volume successfully.
Jul 03 23:56:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-58dc2580-743f-4258-b1f0-13e7d5ea59bd tempest-VolumesServicesTestJSON-1241445105 None] Lock "cinder-74e5018e-46e7-433a-bf7e-90d56b59ff6a-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:56:50 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-740951a8-87da-4812-aa5f-c99652c2c00e 1073741824" returned: 0 in 1.076s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-740951a8-87da-4812-aa5f-c99652c2c00e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:50 devstack sudo[93956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-740951a8-87da-4812-aa5f-c99652c2c00e
Jul 03 23:56:50 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:51 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-740951a8-87da-4812-aa5f-c99652c2c00e" returned: 0 in 0.813s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:56:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.954s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55c126b-06d0-459d-a640-b85a814843a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-740951a8-87da-4812-aa5f-c99652c2c00e', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f09b25-8b73-4e28-957c-6050902f07d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:51 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Volume volume-740951a8-87da-4812-aa5f-c99652c2c00e (740951a8-87da-4812-aa5f-c99652c2c00e): created successfully
Jul 03 23:56:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f09b25-8b73-4e28-957c-6050902f07d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Flow 'volume_create_manager' (19ea77c2-dec4-479c-a203-e2597f0f50bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:51 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-cddd22dd-3a6d-432a-8fde-f8dc0c0fc5ff tempest-VolumesTestJSON-1731407762 None] Created volume successfully.
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Flow 'volume_create_manager' (e3d63943-7cc8-4215-ba1a-b5f78c8cf348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d2dd86-23c3-460d-aaff-ae886d5c2a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d2dd86-23c3-460d-aaff-ae886d5c2a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1172132636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b511336b2de7475faaf9d47de239cd07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:53Z,use_quota=True,user_id='d4cdaf9d8aff45da9ee5abbad5c87868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641e839e-215a-473d-a05d-db52bad80b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641e839e-215a-473d-a05d-db52bad80b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee905558-9b8e-4814-8d65-35b173cd1c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee905558-9b8e-4814-8d65-35b173cd1c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc', 'volume_name': 'volume-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db891a09-8e31-4a28-addc-d6e3f5aa9d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db891a09-8e31-4a28-addc-d6e3f5aa9d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b5f780-4d2a-4794-a05f-e95e9011b25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:53 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Volume f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc', 'volume_size': 1}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1172132636',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b511336b2de7475faaf9d47de239cd07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:53Z,use_quota=True,user_id='d4cdaf9d8aff45da9ee5abbad5c87868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Creating volume f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:56:53 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:56:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:53 devstack sudo[93960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc 1073741824
Jul 03 23:56:53 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:54 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc 1073741824" returned: 0 in 1.328s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:54 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:56:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Flow 'volume_create_manager' (c16116d8-f036-4011-8b58-04ed8a06d9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baefa5d8-75d9-4cca-94cb-537217c9573e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baefa5d8-75d9-4cca-94cb-537217c9573e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1203607623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770a345a-5dbd-4e4b-88ef-891255134339,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e2c18abc9ca4f11b2fde7faab0b7bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:55Z,use_quota=True,user_id='96fe9abc884546dbbc824f597d18c6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18adc788-1e0d-46ee-90a6-8a3613de5428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18adc788-1e0d-46ee-90a6-8a3613de5428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd20a4d5-33b4-4cfb-ad05-55f193f9a737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd20a4d5-33b4-4cfb-ad05-55f193f9a737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770a345a-5dbd-4e4b-88ef-891255134339', 'volume_name': 'volume-770a345a-5dbd-4e4b-88ef-891255134339', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4a74cc-4945-4d9e-8e26-d28558947a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4a74cc-4945-4d9e-8e26-d28558947a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa27ab1-93e8-4553-85db-c81ba002b138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:54 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Volume 770a345a-5dbd-4e4b-88ef-891255134339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770a345a-5dbd-4e4b-88ef-891255134339', 'volume_size': 1}
Jul 03 23:56:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:54 devstack sudo[93966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc
Jul 03 23:56:54 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:55 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc" returned: 0 in 0.734s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] <== create_volume: return (2205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.209s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.766s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1203607623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770a345a-5dbd-4e4b-88ef-891255134339,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e2c18abc9ca4f11b2fde7faab0b7bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:55Z,use_quota=True,user_id='96fe9abc884546dbbc824f597d18c6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Creating volume 770a345a-5dbd-4e4b-88ef-891255134339 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:56:55 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-770a345a-5dbd-4e4b-88ef-891255134339 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:55 devstack sudo[93969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-770a345a-5dbd-4e4b-88ef-891255134339 1073741824
Jul 03 23:56:55 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1b5f780-4d2a-4794-a05f-e95e9011b25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8538f782-b1cf-4393-9200-c238922f254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:55 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Volume volume-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc (f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc): created successfully
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8538f782-b1cf-4393-9200-c238922f254b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Flow 'volume_create_manager' (e3d63943-7cc8-4215-ba1a-b5f78c8cf348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:55 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-1aa49ad8-b6a7-47a5-9fa4-3bc78a5bbb2f tempest-VolumesTestJSON-1731407762 None] Created volume successfully.
Jul 03 23:56:56 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-770a345a-5dbd-4e4b-88ef-891255134339 1073741824" returned: 0 in 1.027s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-770a345a-5dbd-4e4b-88ef-891255134339 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:56 devstack sudo[93982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-770a345a-5dbd-4e4b-88ef-891255134339
Jul 03 23:56:56 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:57 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-770a345a-5dbd-4e4b-88ef-891255134339" returned: 0 in 0.786s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:57 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:56:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aa27ab1-93e8-4553-85db-c81ba002b138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770a345a-5dbd-4e4b-88ef-891255134339', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff00380-cfc2-488a-bbfb-9cc17da43ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:57 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Volume volume-770a345a-5dbd-4e4b-88ef-891255134339 (770a345a-5dbd-4e4b-88ef-891255134339): created successfully
Jul 03 23:56:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff00380-cfc2-488a-bbfb-9cc17da43ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Flow 'volume_create_manager' (c16116d8-f036-4011-8b58-04ed8a06d9a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:57 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-50d30131-2293-4b35-ad71-34f927082ce6 tempest-VolumesListTestJSON-1177594648 None] Created volume successfully.
Jul 03 23:56:57 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Acquiring lock "cinder-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:57 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Lock "cinder-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Acquiring lock "cinder-quobyte-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Lock "cinder-quobyte-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc" acquired by "delete_volume" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea562774-16a2-4aeb-b056-1901f6430955]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:58 devstack sudo[93987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc
Jul 03 23:56:58 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Flow 'volume_create_manager' (8f76b5f7-3389-49cb-9123-6bee2d8da1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfd886e-56a0-4993-8690-64ad9582e792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfd886e-56a0-4993-8690-64ad9582e792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-728620751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05bd648-75a7-45f2-969c-ab743b9f489b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c44b12bcded4a1dbbc99b602500e47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:58Z,use_quota=True,user_id='cf0d08b4f0424ac9980fa4b8c333ae27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a66d8564-dbb4-4061-890b-82fda9e36007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a66d8564-dbb4-4061-890b-82fda9e36007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (265768b7-e1de-4ffa-9ec8-51a2891ed573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (265768b7-e1de-4ffa-9ec8-51a2891ed573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c05bd648-75a7-45f2-969c-ab743b9f489b', 'volume_name': 'volume-c05bd648-75a7-45f2-969c-ab743b9f489b', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59154e2-2f37-4c54-8791-73c9820f8f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d59154e2-2f37-4c54-8791-73c9820f8f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e543df8b-5837-4ba2-b64c-5182299f1673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:58 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Volume c05bd648-75a7-45f2-969c-ab743b9f489b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c05bd648-75a7-45f2-969c-ab743b9f489b', 'volume_size': 1}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-728620751',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05bd648-75a7-45f2-969c-ab743b9f489b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c44b12bcded4a1dbbc99b602500e47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:58Z,use_quota=True,user_id='cf0d08b4f0424ac9980fa4b8c333ae27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Creating volume c05bd648-75a7-45f2-969c-ab743b9f489b {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:56:58 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c05bd648-75a7-45f2-969c-ab743b9f489b 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:58 devstack sudo[93989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c05bd648-75a7-45f2-969c-ab743b9f489b 1073741824
Jul 03 23:56:58 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Flow 'volume_create_manager' (b1fb4711-6ae2-4ccc-a16a-c4ab97b1aeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f5ffb5-eced-43bd-92a6-a2a894b548b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f5ffb5-eced-43bd-92a6-a2a894b548b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1188567695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92d9d9a-1d49-481c-beeb-65956987d41e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e2c18abc9ca4f11b2fde7faab0b7bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:59Z,use_quota=True,user_id='96fe9abc884546dbbc824f597d18c6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420c593a-207b-4f9e-bbcf-f6935e53f946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (420c593a-207b-4f9e-bbcf-f6935e53f946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e99a631-6af0-4052-bea4-bb25baff827f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e99a631-6af0-4052-bea4-bb25baff827f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c92d9d9a-1d49-481c-beeb-65956987d41e', 'volume_name': 'volume-c92d9d9a-1d49-481c-beeb-65956987d41e', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5e8c96-93d6-43f4-a92a-17de6e3a398e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5e8c96-93d6-43f4-a92a-17de6e3a398e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d100695-cd28-4ddc-8627-b48fb4010995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:56:58 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Volume c92d9d9a-1d49-481c-beeb-65956987d41e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c92d9d9a-1d49-481c-beeb-65956987d41e', 'volume_size': 1}
Jul 03 23:56:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:56:59 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc" returned: 0 in 1.205s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:59 devstack sudo[93994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc
Jul 03 23:56:59 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:56:59 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root
Jul 03 23:56:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c05bd648-75a7-45f2-969c-ab743b9f489b 1073741824" returned: 0 in 1.171s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:56:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c05bd648-75a7-45f2-969c-ab743b9f489b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:56:59 devstack sudo[93999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c05bd648-75a7-45f2-969c-ab743b9f489b
Jul 03 23:56:59 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:00 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc" returned: 0 in 0.811s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Lock "cinder-quobyte-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc" released by "delete_volume" :: held 2.106s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Created reservations ['19753e4a-cb11-44f7-8ec1-e10f81770a85', '4dc2dacb-e7ee-4b48-9506-79b4688a2094', '82b6cfa3-6d41-4f6e-83f0-6bd9bbca18b4', '61c5ae14-4850-4072-9842-900a45866bfe'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:00 devstack sudo[94003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:57:00 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:00 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c05bd648-75a7-45f2-969c-ab743b9f489b" returned: 0 in 0.713s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.401s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1188567695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c92d9d9a-1d49-481c-beeb-65956987d41e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e2c18abc9ca4f11b2fde7faab0b7bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:56:59Z,use_quota=True,user_id='96fe9abc884546dbbc824f597d18c6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Creating volume c92d9d9a-1d49-481c-beeb-65956987d41e {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:57:00 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c92d9d9a-1d49-481c-beeb-65956987d41e 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e543df8b-5837-4ba2-b64c-5182299f1673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c05bd648-75a7-45f2-969c-ab743b9f489b', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b063d26-1842-45ad-a4ed-a4fc6d0c78f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:00 devstack sudo[94005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c92d9d9a-1d49-481c-beeb-65956987d41e 1073741824
Jul 03 23:57:00 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:00 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Volume volume-c05bd648-75a7-45f2-969c-ab743b9f489b (c05bd648-75a7-45f2-969c-ab743b9f489b): created successfully
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b063d26-1842-45ad-a4ed-a4fc6d0c78f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Flow 'volume_create_manager' (8f76b5f7-3389-49cb-9123-6bee2d8da1b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:00 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-0feb0939-9bb2-4c01-9949-46fedc372786 tempest-AttachVolumeNegativeTest-608528329 None] Created volume successfully.
Jul 03 23:57:01 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.745s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:01 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:57:01 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Deleted volume successfully.
Jul 03 23:57:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-62d85f9b-1de8-4b1a-af32-d0bc110f97ca tempest-VolumesTestJSON-1731407762 None] Lock "cinder-f6ccacb5-55fb-4ea9-9d2c-41c1caddbacc-delete_volume" released by "delete_volume" :: held 3.143s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:01 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c92d9d9a-1d49-481c-beeb-65956987d41e 1073741824" returned: 0 in 0.904s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c92d9d9a-1d49-481c-beeb-65956987d41e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Acquiring lock "cinder-740951a8-87da-4812-aa5f-c99652c2c00e-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:01 devstack sudo[94012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c92d9d9a-1d49-481c-beeb-65956987d41e
Jul 03 23:57:01 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Lock "cinder-740951a8-87da-4812-aa5f-c99652c2c00e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Acquiring lock "cinder-quobyte-740951a8-87da-4812-aa5f-c99652c2c00e" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Lock "cinder-quobyte-740951a8-87da-4812-aa5f-c99652c2c00e" acquired by "delete_volume" :: waited 0.027s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:01 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3f6121-083c-41d0-b13c-c40a886d3cb9]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-740951a8-87da-4812-aa5f-c99652c2c00e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:01 devstack sudo[94014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-740951a8-87da-4812-aa5f-c99652c2c00e
Jul 03 23:57:01 devstack sudo[94014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:02 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c92d9d9a-1d49-481c-beeb-65956987d41e" returned: 0 in 0.756s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:57:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d100695-cd28-4ddc-8627-b48fb4010995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c92d9d9a-1d49-481c-beeb-65956987d41e', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3e2a87-13a6-4d1b-8100-52b0dd55a315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:02 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Volume volume-c92d9d9a-1d49-481c-beeb-65956987d41e (c92d9d9a-1d49-481c-beeb-65956987d41e): created successfully
Jul 03 23:57:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db3e2a87-13a6-4d1b-8100-52b0dd55a315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Flow 'volume_create_manager' (b1fb4711-6ae2-4ccc-a16a-c4ab97b1aeb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:02 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-52cca3ae-a640-4a74-a2b3-837f40b9a73f tempest-VolumesListTestJSON-1177594648 None] Created volume successfully.
Jul 03 23:57:02 devstack sudo[94014]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-740951a8-87da-4812-aa5f-c99652c2c00e" returned: 0 in 0.979s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-740951a8-87da-4812-aa5f-c99652c2c00e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:02 devstack sudo[94024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-740951a8-87da-4812-aa5f-c99652c2c00e
Jul 03 23:57:02 devstack sudo[94024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:03 devstack sudo[94024]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-740951a8-87da-4812-aa5f-c99652c2c00e" returned: 0 in 0.829s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Lock "cinder-quobyte-740951a8-87da-4812-aa5f-c99652c2c00e" released by "delete_volume" :: held 1.885s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:03 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Created reservations ['c33c8a15-5906-413b-bbc8-84653b2df4bb', '46c444a1-6390-4dd5-9362-16696d44b46a', '9b100bd4-a496-4454-aef3-4c621484c3d6', 'ec58e7f1-d5b2-4621-9481-85edb9e00096'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:03 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:03 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:03 devstack sudo[94028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:57:03 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Acquiring lock "cinder-ccf1c443-e586-4e14-89aa-d32f1027d514-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Lock "cinder-ccf1c443-e586-4e14-89aa-d32f1027d514-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Acquiring lock "cinder-quobyte-ccf1c443-e586-4e14-89aa-d32f1027d514" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Lock "cinder-quobyte-ccf1c443-e586-4e14-89aa-d32f1027d514" acquired by "delete_volume" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:03 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b92727-195a-4e1e-b08b-ffc11137c97e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccf1c443-e586-4e14-89aa-d32f1027d514 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Flow 'volume_create_manager' (02db2b9f-d2cc-4574-b45f-25cd1504af82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b450e2b0-30c5-43ca-9782-ce7f82e6e544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b450e2b0-30c5-43ca-9782-ce7f82e6e544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1218436808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9af6fba-db86-4457-ab81-326ced076dbb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e2c18abc9ca4f11b2fde7faab0b7bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:04Z,use_quota=True,user_id='96fe9abc884546dbbc824f597d18c6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec312d1-b58f-4d87-bbc3-95074d839495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec312d1-b58f-4d87-bbc3-95074d839495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c58b25-d54c-46ec-b836-c37b5497ca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0c58b25-d54c-46ec-b836-c37b5497ca4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9af6fba-db86-4457-ab81-326ced076dbb', 'volume_name': 'volume-e9af6fba-db86-4457-ab81-326ced076dbb', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0d6149-4b55-41e0-ade0-014311881bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:04 devstack sudo[94031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccf1c443-e586-4e14-89aa-d32f1027d514
Jul 03 23:57:04 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0d6149-4b55-41e0-ade0-014311881bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa76e6ee-dcb8-4bb2-bf10-4244d52c12a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:04 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Volume e9af6fba-db86-4457-ab81-326ced076dbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9af6fba-db86-4457-ab81-326ced076dbb', 'volume_size': 1}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1218436808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9af6fba-db86-4457-ab81-326ced076dbb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e2c18abc9ca4f11b2fde7faab0b7bc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:04Z,use_quota=True,user_id='96fe9abc884546dbbc824f597d18c6f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Creating volume e9af6fba-db86-4457-ab81-326ced076dbb {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:57:04 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e9af6fba-db86-4457-ab81-326ced076dbb 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:04 devstack sudo[94033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e9af6fba-db86-4457-ab81-326ced076dbb 1073741824
Jul 03 23:57:04 devstack sudo[94033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:04 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.220s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:57:04 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Deleted volume successfully.
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=108,cinder:SELECT=96,cinder:INSERT=31,cinder:DELETE=8 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-87d9c532-bc4b-426f-8ef6-79b396b6fd48 tempest-VolumesTestJSON-1731407762 None] Lock "cinder-740951a8-87da-4812-aa5f-c99652c2c00e-delete_volume" released by "delete_volume" :: held 3.481s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=124,cinder:SELECT=90,cinder:INSERT=30,cinder:DELETE=8 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:57:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-d7a8a578-ab06-4fbc-ab57-c2860b4a54c6 req-76c700a6-4607-4422-96f4-88e8811347a3 tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:05 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccf1c443-e586-4e14-89aa-d32f1027d514" returned: 0 in 1.134s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccf1c443-e586-4e14-89aa-d32f1027d514 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:05 devstack sudo[94051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccf1c443-e586-4e14-89aa-d32f1027d514
Jul 03 23:57:05 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:05 devstack sudo[94033]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e9af6fba-db86-4457-ab81-326ced076dbb 1073741824" returned: 0 in 1.333s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e9af6fba-db86-4457-ab81-326ced076dbb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:05 devstack sudo[94054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e9af6fba-db86-4457-ab81-326ced076dbb
Jul 03 23:57:05 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:06 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccf1c443-e586-4e14-89aa-d32f1027d514" returned: 0 in 0.916s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Lock "cinder-quobyte-ccf1c443-e586-4e14-89aa-d32f1027d514" released by "delete_volume" :: held 2.141s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Created reservations ['6147a6b9-08c3-4ab6-9e5f-1167a4c53923', '819ef12e-571d-441a-a3a2-dccf8e9305a1', 'f074b238-77e1-4ec1-a7b4-66f3e4e48da3', '4faefc09-5923-4d6f-8f12-3b72db4b44b1'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:06 devstack sudo[94057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:57:06 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:06 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e9af6fba-db86-4457-ab81-326ced076dbb" returned: 0 in 0.866s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] <== create_volume: return (2259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.262s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-d7a8a578-ab06-4fbc-ab57-c2860b4a54c6 req-76c700a6-4607-4422-96f4-88e8811347a3 tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.509s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa76e6ee-dcb8-4bb2-bf10-4244d52c12a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9af6fba-db86-4457-ab81-326ced076dbb', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6a67c1-1f47-426f-8b99-010c6491224e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2e1371-9eca-4b84-8535-b73f290d2794]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-d7a8a578-ab06-4fbc-ab57-c2860b4a54c6 req-76c700a6-4607-4422-96f4-88e8811347a3 tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c05bd648-75a7-45f2-969c-ab743b9f489b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:06 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Volume volume-e9af6fba-db86-4457-ab81-326ced076dbb (e9af6fba-db86-4457-ab81-326ced076dbb): created successfully
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6a67c1-1f47-426f-8b99-010c6491224e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Flow 'volume_create_manager' (02db2b9f-d2cc-4574-b45f-25cd1504af82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:06 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-222f2cda-8463-4717-8056-953c24a687a6 tempest-VolumesListTestJSON-1177594648 None] Created volume successfully.
Jul 03 23:57:06 devstack sudo[94060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c05bd648-75a7-45f2-969c-ab743b9f489b
Jul 03 23:57:06 devstack sudo[94060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:06 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.763s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:06 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:57:06 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Deleted volume successfully.
Jul 03 23:57:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c0378831-7514-4139-8bee-47b914de1a30 tempest-VolumesTestJSON-1731407762 None] Lock "cinder-ccf1c443-e586-4e14-89aa-d32f1027d514-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:07 devstack sudo[94060]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-d7a8a578-ab06-4fbc-ab57-c2860b4a54c6 req-76c700a6-4607-4422-96f4-88e8811347a3 tempest-AttachVolumeNegativeTest-608528329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c05bd648-75a7-45f2-969c-ab743b9f489b" returned: 0 in 0.944s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-d7a8a578-ab06-4fbc-ab57-c2860b4a54c6 req-76c700a6-4607-4422-96f4-88e8811347a3 tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.983s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-d7a8a578-ab06-4fbc-ab57-c2860b4a54c6 req-76c700a6-4607-4422-96f4-88e8811347a3 tempest-AttachVolumeNegativeTest-608528329 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-c05bd648-75a7-45f2-969c-ab743b9f489b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20c15dbc-cf8b-4a60-beca-fecb0f4e7ac5', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:57:07 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-d7a8a578-ab06-4fbc-ab57-c2860b4a54c6 req-76c700a6-4607-4422-96f4-88e8811347a3 tempest-AttachVolumeNegativeTest-608528329 None] attachment_update completed successfully.
Jul 03 23:57:08 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:57:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Flow 'volume_create_manager' (b1fbd8da-f32b-4a07-9b83-1028af9fc7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab083840-8561-4075-b9e2-f0864a1feedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab083840-8561-4075-b9e2-f0864a1feedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-592022120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cf6576-6f59-4f5e-9a48-f93ba079bc46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b2d6531f1441a68254ce208644657c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:09Z,use_quota=True,user_id='5c0f18c5390b4929b28f82cff2b82f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6ebaa8-f760-49b4-94ce-5d4c43f424a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6ebaa8-f760-49b4-94ce-5d4c43f424a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40d6a9c-6bd0-4e0d-98ca-cde5f0b86df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:09 devstack cinder-volume[86650]: DEBUG cinder.image.glance [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Creating Keystone auth plugin from conf {{(pid=86650) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 23:57:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d40d6a9c-6bd0-4e0d-98ca-cde5f0b86df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '99cf6576-6f59-4f5e-9a48-f93ba079bc46', 'volume_name': 'volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46', 'volume_size': 1, 'image_id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee7f20f7f01043bc91ea80a8d5f6c3f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'created_at': datetime.datetime(2026, 7, 3, 21, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 43, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000bcea20>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d60121-ae7d-474a-ba7a-1ce4cf68d62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93d60121-ae7d-474a-ba7a-1ce4cf68d62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02992b1-c772-4ec7-8349-e05f0aff98a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:09 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Volume 99cf6576-6f59-4f5e-9a48-f93ba079bc46: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46', 'volume_size': 1, 'image_id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee7f20f7f01043bc91ea80a8d5f6c3f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'created_at': datetime.datetime(2026, 7, 3, 21, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 43, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000bcea20>}
Jul 03 23:57:09 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Trying to clone 99cf6576-6f59-4f5e-9a48-f93ba079bc46 from image b8f0cc76-877f-40ea-bce4-db07a2ff6489 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}]). {{(pid=86650) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 23:57:10 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_ybvvfpg9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 23:57:10 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Image download 20.69 MB at 20.69 MB/s
Jul 03 23:57:10 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe0c02f-3f2e-4fbd-bff5-292126a78b5a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_ybvvfpg9devstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Acquiring lock "cinder-e9af6fba-db86-4457-ab81-326ced076dbb-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Lock "cinder-e9af6fba-db86-4457-ab81-326ced076dbb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Acquiring lock "cinder-quobyte-e9af6fba-db86-4457-ab81-326ced076dbb" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:10 devstack sudo[94460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_ybvvfpg9devstack@QuobyteHD
Jul 03 23:57:10 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Lock "cinder-quobyte-e9af6fba-db86-4457-ab81-326ced076dbb" acquired by "delete_volume" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:10 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bc0931-44ba-4e2f-8b70-cdae45b17aa4]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e9af6fba-db86-4457-ab81-326ced076dbb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:10 devstack sudo[94462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e9af6fba-db86-4457-ab81-326ced076dbb
Jul 03 23:57:10 devstack sudo[94462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:10 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_ybvvfpg9devstack@QuobyteHD" returned: 0 in 0.886s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:10 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Temporary image b8f0cc76-877f-40ea-bce4-db07a2ff6489 is fetched for user 5c0f18c5390b4929b28f82cff2b82f99. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[085f3b19-4592-4cb6-b107-6198fd7021db]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_ybvvfpg9devstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:11 devstack sudo[94462]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e9af6fba-db86-4457-ab81-326ced076dbb" returned: 0 in 0.865s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e9af6fba-db86-4457-ab81-326ced076dbb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:11 devstack sudo[94472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e9af6fba-db86-4457-ab81-326ced076dbb
Jul 03 23:57:11 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:11 devstack sudo[94471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_ybvvfpg9devstack@QuobyteHD
Jul 03 23:57:11 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:11 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_ybvvfpg9devstack@QuobyteHD" returned: 0 in 0.835s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-592022120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99cf6576-6f59-4f5e-9a48-f93ba079bc46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3b2d6531f1441a68254ce208644657c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:09Z,use_quota=True,user_id='5c0f18c5390b4929b28f82cff2b82f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Creating volume 99cf6576-6f59-4f5e-9a48-f93ba079bc46 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:57:11 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:11 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e9af6fba-db86-4457-ab81-326ced076dbb" returned: 0 in 0.790s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:11 devstack sudo[94479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46 1073741824
Jul 03 23:57:11 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Lock "cinder-quobyte-e9af6fba-db86-4457-ab81-326ced076dbb" released by "delete_volume" :: held 1.718s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:12 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Created reservations ['ef1a1eb3-a6df-4647-ab48-b8993033d7eb', '7ff6a032-e212-4466-a1cd-57c6bbfa3341', '30c631f3-1480-4f0a-a4e0-55b792e99c5c', '5c9d10e4-9950-49f5-9ab5-2d15d7c74bcb'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:12 devstack sudo[94481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:57:12 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Acquiring lock "cinder-c92d9d9a-1d49-481c-beeb-65956987d41e-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Lock "cinder-c92d9d9a-1d49-481c-beeb-65956987d41e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Acquiring lock "cinder-quobyte-c92d9d9a-1d49-481c-beeb-65956987d41e" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Lock "cinder-quobyte-c92d9d9a-1d49-481c-beeb-65956987d41e" acquired by "delete_volume" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:12 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4fa937-fbdc-4c6a-b5da-f7558951be44]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c92d9d9a-1d49-481c-beeb-65956987d41e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:12 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-8e04ac61-4cb4-460d-b884-1a71bc1730cf tempest-GroupSnapshotsV319Test-2104998572 None] Group tempest-GroupSnapshotsV319Test-Group-2066539338: creating
Jul 03 23:57:13 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-8e04ac61-4cb4-460d-b884-1a71bc1730cf tempest-GroupSnapshotsV319Test-2104998572 None] Group tempest-GroupSnapshotsV319Test-Group-2066539338: created successfully
Jul 03 23:57:13 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-8e04ac61-4cb4-460d-b884-1a71bc1730cf tempest-GroupSnapshotsV319Test-2104998572 None] Create group completed successfully.
Jul 03 23:57:13 devstack sudo[94486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c92d9d9a-1d49-481c-beeb-65956987d41e
Jul 03 23:57:13 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:13 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46 1073741824" returned: 0 in 1.338s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:13 devstack sudo[94490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46
Jul 03 23:57:13 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:13 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.365s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:13 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:57:13 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Deleted volume successfully.
Jul 03 23:57:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c6b0edd2-e8c5-4be0-91aa-f9df5ba83055 tempest-VolumesListTestJSON-1177594648 None] Lock "cinder-e9af6fba-db86-4457-ab81-326ced076dbb-delete_volume" released by "delete_volume" :: held 3.411s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:14 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c92d9d9a-1d49-481c-beeb-65956987d41e" returned: 0 in 1.181s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c92d9d9a-1d49-481c-beeb-65956987d41e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:14 devstack sudo[94497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c92d9d9a-1d49-481c-beeb-65956987d41e
Jul 03 23:57:14 devstack sudo[94497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:14 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46" returned: 0 in 0.813s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:57:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.228s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:14 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Attempting download of b8f0cc76-877f-40ea-bce4-db07a2ff6489 ((None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}])) to volume 99cf6576-6f59-4f5e-9a48-f93ba079bc46. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 23:57:14 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[113a0d89-0a87-4739-8dba-44b529420799]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_yotnt9tm {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:14 devstack sudo[94499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_yotnt9tm
Jul 03 23:57:14 devstack sudo[94499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:57:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:14 devstack sudo[94501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:57:14 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Flow 'volume_create_manager' (251ba2ca-1256-461b-9baf-b6572caac0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58d4d7f-f1bb-4d9f-88c7-8834541bdccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a58d4d7f-f1bb-4d9f-88c7-8834541bdccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1609238096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a46cf81b-2166-480e-bcd7-c2af55741250,host='devstack@QuobyteHD#QuobyteHD',id=f03839df-f979-41fd-af01-0c77478be527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4351e390f9bc439cb9aac86f6fbaaf0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:15Z,use_quota=True,user_id='2d28c31d0aea44fc9b31e0140a4d94a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8386fb65-88c0-4841-8a64-de5506a1acec),volume_type_id=8386fb65-88c0-4841-8a64-de5506a1acec)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1199381-8b6c-454d-aba5-a5ed1bc8cb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1199381-8b6c-454d-aba5-a5ed1bc8cb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef2fa40-3aab-47a2-82d9-7fb4060a4eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef2fa40-3aab-47a2-82d9-7fb4060a4eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f03839df-f979-41fd-af01-0c77478be527', 'volume_name': 'volume-f03839df-f979-41fd-af01-0c77478be527', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:15 devstack sudo[94497]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00578057-7e6d-4391-9520-9cf393c927f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00578057-7e6d-4391-9520-9cf393c927f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e470a746-b4da-4c6e-b5a4-e558648aaf63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:15 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Volume f03839df-f979-41fd-af01-0c77478be527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f03839df-f979-41fd-af01-0c77478be527', 'volume_size': 1}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a46cf81b-2166-480e-bcd7-c2af55741250,created_at=2026-07-03T21:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1609238096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a46cf81b-2166-480e-bcd7-c2af55741250,host='devstack@QuobyteHD#QuobyteHD',id=f03839df-f979-41fd-af01-0c77478be527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4351e390f9bc439cb9aac86f6fbaaf0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:15Z,use_quota=True,user_id='2d28c31d0aea44fc9b31e0140a4d94a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8386fb65-88c0-4841-8a64-de5506a1acec),volume_type_id=8386fb65-88c0-4841-8a64-de5506a1acec)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Creating volume f03839df-f979-41fd-af01-0c77478be527 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:57:15 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c92d9d9a-1d49-481c-beeb-65956987d41e" returned: 0 in 1.136s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Lock "cinder-quobyte-c92d9d9a-1d49-481c-beeb-65956987d41e" released by "delete_volume" :: held 2.393s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:15 devstack sudo[94504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527 1073741824
Jul 03 23:57:15 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Created reservations ['db15616e-784c-479e-8143-c55cbbbc2166', 'e59eb6fe-89d9-4c62-ba56-46462bc57926', '87fbfd16-afca-4ecb-aee1-468020d65e6a', '01a0895b-3c57-409b-85d8-9191abc44119'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:15 devstack sudo[94509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:57:15 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:15 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.045s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 28 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:57:15 devstack sudo[94499]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_yotnt9tm" returned: 0 in 1.338s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_yotnt9tm {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:15 devstack sudo[94511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_yotnt9tm
Jul 03 23:57:15 devstack sudo[94511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Acquiring lock "cinder-770a345a-5dbd-4e4b-88ef-891255134339-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Lock "cinder-770a345a-5dbd-4e4b-88ef-891255134339-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Acquiring lock "cinder-quobyte-770a345a-5dbd-4e4b-88ef-891255134339" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Lock "cinder-quobyte-770a345a-5dbd-4e4b-88ef-891255134339" acquired by "delete_volume" :: waited 0.028s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:16 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[49169d9d-8fa5-4186-b292-0bb9f6541040]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-770a345a-5dbd-4e4b-88ef-891255134339 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:16 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.031s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:16 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:57:16 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Deleted volume successfully.
Jul 03 23:57:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d9fcf555-ac4f-4a84-bae5-7fe6e7c9085e tempest-VolumesListTestJSON-1177594648 None] Lock "cinder-c92d9d9a-1d49-481c-beeb-65956987d41e-delete_volume" released by "delete_volume" :: held 3.835s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:16 devstack sudo[94517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-770a345a-5dbd-4e4b-88ef-891255134339
Jul 03 23:57:16 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:16 devstack sudo[94511]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_yotnt9tm" returned: 1 in 1.043s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_yotnt9tm' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:57:16 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[da65384f-3560-4113-8818-5ccc00f386d1]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_ybvvfpg9devstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:16 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527 1073741824" returned: 0 in 1.532s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:16 devstack sudo[94523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527
Jul 03 23:57:16 devstack sudo[94523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:16 devstack sudo[94522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_ybvvfpg9devstack@QuobyteHD
Jul 03 23:57:16 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:17 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-770a345a-5dbd-4e4b-88ef-891255134339" returned: 0 in 1.033s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-770a345a-5dbd-4e4b-88ef-891255134339 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:17 devstack sudo[94538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-770a345a-5dbd-4e4b-88ef-891255134339
Jul 03 23:57:17 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:17 devstack sudo[94523]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527" returned: 0 in 0.913s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:17 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:17 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] <== create_volume: return (2491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:57:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.499s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_ybvvfpg9devstack@QuobyteHD" returned: 0 in 1.022s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:17 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] b8f0cc76-877f-40ea-bce4-db07a2ff6489 was qcow2, converting to raw {{(pid=86650) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 23:57:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_ybvvfpg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:17 devstack sudo[94540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_ybvvfpg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46
Jul 03 23:57:17 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e470a746-b4da-4c6e-b5a4-e558648aaf63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f03839df-f979-41fd-af01-0c77478be527', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce49eb82-9dda-411a-a7e9-9721b2f60485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:17 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Volume volume-f03839df-f979-41fd-af01-0c77478be527 (f03839df-f979-41fd-af01-0c77478be527): created successfully
Jul 03 23:57:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce49eb82-9dda-411a-a7e9-9721b2f60485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Flow 'volume_create_manager' (251ba2ca-1256-461b-9baf-b6572caac0f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:17 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-91c45c12-0708-42c4-8c17-56d13ba240fb tempest-GroupSnapshotsV319Test-2104998572 None] Created volume successfully.
Jul 03 23:57:18 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-770a345a-5dbd-4e4b-88ef-891255134339" returned: 0 in 0.716s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Lock "cinder-quobyte-770a345a-5dbd-4e4b-88ef-891255134339" released by "delete_volume" :: held 1.830s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:18 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Created reservations ['01901e9a-b91c-4580-b72e-f3f0af1e39e9', '914dbde3-0dfb-4c39-b560-c51c43a3a1ea', '005e0b9b-11f4-40a0-a6e7-2932666f2017', 'cb5f06c7-5218-4320-b167-badd72e5efd5'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:18 devstack sudo[94547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:57:18 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:19 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] GroupSnapshot 0912a94b-daff-42bf-beed-1ecdbc4a1c4a: creating.
Jul 03 23:57:19 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.862s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:19 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:57:19 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Deleted volume successfully.
Jul 03 23:57:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] Group snapshot 0912a94b-daff-42bf-beed-1ecdbc4a1c4a: creating. {{(pid=86650) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 03 23:57:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9060711a-4e82-4eb7-b766-00df300158ab tempest-VolumesListTestJSON-1177594648 None] Lock "cinder-770a345a-5dbd-4e4b-88ef-891255134339-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] Creating offline snapshot 9cb5d383-ed46-43fd-9acb-7bf79f252948 of volume f03839df-f979-41fd-af01-0c77478be527 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:57:19 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[592eb0fb-7b18-4e26-a94f-382b4d265c4d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:19 devstack sudo[94552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527
Jul 03 23:57:19 devstack sudo[94552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:20 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_ybvvfpg9devstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46" returned: 0 in 2.482s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:20 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_ybvvfpg9devstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46 {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 23:57:20 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Converted 112.00 MB image at 45.09 MB/s
Jul 03 23:57:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:20 devstack sudo[94554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46 1G
Jul 03 23:57:20 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:20 devstack sudo[94552]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527" returned: 0 in 1.133s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:20 devstack sudo[94559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948 1G
Jul 03 23:57:20 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:20 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46 1G" returned: 0 in 0.836s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:21 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[363b4180-7674-4cc1-b521-662733712634]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:21 devstack sudo[94564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46
Jul 03 23:57:21 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:21 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948 1G" returned: 0 in 1.050s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03839df-f979-41fd-af01-0c77478be527 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:21 devstack sudo[94570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03839df-f979-41fd-af01-0c77478be527 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948
Jul 03 23:57:21 devstack sudo[94570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:22 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46" returned: 0 in 1.121s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:22 devstack sudo[94574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46
Jul 03 23:57:22 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:22 devstack sudo[94570]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f03839df-f979-41fd-af01-0c77478be527 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948" returned: 0 in 0.891s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:22 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948 is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:57:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:22 devstack sudo[94580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948
Jul 03 23:57:22 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Flow 'volume_create_manager' (e16c4fbc-7b12-488e-832d-ddaaa0e82819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc0ad59-af6a-4755-a5a8-246b380aeab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc0ad59-af6a-4755-a5a8-246b380aeab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-326606326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154caa2d-3482-4120-94c8-22dbaa8948b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff3c517c6374adfaa70812f0dd5cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:23Z,use_quota=True,user_id='32ad4de410c148f8a7ac4b8ac64db235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:23 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a131307-defc-4c95-afb6-bd7c83de0b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a131307-defc-4c95-afb6-bd7c83de0b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1a49b0-b7aa-489c-9eb3-69cbf072cb72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1a49b0-b7aa-489c-9eb3-69cbf072cb72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '154caa2d-3482-4120-94c8-22dbaa8948b5', 'volume_name': 'volume-154caa2d-3482-4120-94c8-22dbaa8948b5', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ddf9571-24de-4c24-b6ea-250bb9bb98a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ddf9571-24de-4c24-b6ea-250bb9bb98a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56226042-b763-4323-a360-486a71842b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:23 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Volume 154caa2d-3482-4120-94c8-22dbaa8948b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-154caa2d-3482-4120-94c8-22dbaa8948b5', 'volume_size': 1}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46" returned: 1 in 1.285s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Downloaded image b8f0cc76-877f-40ea-bce4-db07a2ff6489 ((None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}])) to volume 99cf6576-6f59-4f5e-9a48-f93ba079bc46 successfully. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Temporary image b8f0cc76-877f-40ea-bce4-db07a2ff6489 for user 5c0f18c5390b4929b28f82cff2b82f99 is deleted. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Marking volume 99cf6576-6f59-4f5e-9a48-f93ba079bc46 as bootable. {{(pid=86650) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Copying metadata from image b8f0cc76-877f-40ea-bce4-db07a2ff6489 to 99cf6576-6f59-4f5e-9a48-f93ba079bc46. {{(pid=86650) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Creating volume glance metadata for volume 99cf6576-6f59-4f5e-9a48-f93ba079bc46 backed by image b8f0cc76-877f-40ea-bce4-db07a2ff6489 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86650) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 23:57:23 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948" returned: 0 in 1.061s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:23 devstack sudo[94587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.info
Jul 03 23:57:23 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02992b1-c772-4ec7-8349-e05f0aff98a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46', 'volume_size': 1, 'image_id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee7f20f7f01043bc91ea80a8d5f6c3f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'created_at': datetime.datetime(2026, 7, 3, 21, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 43, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000bcea20>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0379157-ee41-4e88-9e5d-f32d38f25538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:23 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Volume volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46 (99cf6576-6f59-4f5e-9a48-f93ba079bc46): created successfully
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0379157-ee41-4e88-9e5d-f32d38f25538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Flow 'volume_create_manager' (b1fbd8da-f32b-4a07-9b83-1028af9fc7f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:23 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c62f29fb-ca8d-4432-a62b-ea55376543a5 tempest-VolumesImageMetadata-442901315 None] Created volume successfully.
Jul 03 23:57:24 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.info" returned: 0 in 0.732s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:24 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 03 23:57:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:24 devstack sudo[94601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.info
Jul 03 23:57:24 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Acquiring lock "cinder-99cf6576-6f59-4f5e-9a48-f93ba079bc46-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Lock "cinder-99cf6576-6f59-4f5e-9a48-f93ba079bc46-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Acquiring lock "cinder-quobyte-99cf6576-6f59-4f5e-9a48-f93ba079bc46" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Lock "cinder-quobyte-99cf6576-6f59-4f5e-9a48-f93ba079bc46" acquired by "delete_volume" :: waited 0.037s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:24 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed979b0-1f67-44dd-85f1-616005d38cc5]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:25 devstack sudo[94610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46
Jul 03 23:57:25 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:25 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.info" returned: 0 in 0.871s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.883s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.746s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-326606326',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=154caa2d-3482-4120-94c8-22dbaa8948b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ff3c517c6374adfaa70812f0dd5cf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:23Z,use_quota=True,user_id='32ad4de410c148f8a7ac4b8ac64db235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:57:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Creating volume 154caa2d-3482-4120-94c8-22dbaa8948b5 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:57:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:57:25 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:57:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-154caa2d-3482-4120-94c8-22dbaa8948b5 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:25 devstack sudo[94613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-154caa2d-3482-4120-94c8-22dbaa8948b5 1073741824
Jul 03 23:57:25 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:25 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-051bf39f-c939-41e3-aba6-5e89237acc4b tempest-GroupSnapshotsV319Test-2104998572 None] group_snapshot 0912a94b-daff-42bf-beed-1ecdbc4a1c4a: created successfully
Jul 03 23:57:25 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46" returned: 0 in 0.863s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:25 devstack sudo[94618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46
Jul 03 23:57:25 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:26 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:26 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] group_snapshot 0912a94b-daff-42bf-beed-1ecdbc4a1c4a: deleting
Jul 03 23:57:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-154caa2d-3482-4120-94c8-22dbaa8948b5 1073741824" returned: 0 in 1.086s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] group_snapshot 0912a94b-daff-42bf-beed-1ecdbc4a1c4a: deleting {{(pid=86650) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 03 23:57:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-154caa2d-3482-4120-94c8-22dbaa8948b5 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] Acquiring lock "cinder-quobyte-f03839df-f979-41fd-af01-0c77478be527" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:26 devstack sudo[94624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-154caa2d-3482-4120-94c8-22dbaa8948b5
Jul 03 23:57:26 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] Lock "cinder-quobyte-f03839df-f979-41fd-af01-0c77478be527" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] Acquiring lock "cinder-quobyte-9cb5d383-ed46-43fd-9acb-7bf79f252948" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] Lock "cinder-quobyte-9cb5d383-ed46-43fd-9acb-7bf79f252948" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] Deleting offline snapshot 9cb5d383-ed46-43fd-9acb-7bf79f252948 of volume f03839df-f979-41fd-af01-0c77478be527 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:57:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] snapshot_file for this snap is: volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:57:26 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf751f5-6bd7-4146-8d9d-ccfa9dbcf735]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:26 devstack sudo[94627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948
Jul 03 23:57:26 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:26 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46" returned: 1 in 0.874s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:57:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:26 devstack sudo[94632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46
Jul 03 23:57:26 devstack sudo[94632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:27 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-154caa2d-3482-4120-94c8-22dbaa8948b5" returned: 0 in 0.817s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] <== create_volume: return (1982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.985s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56226042-b763-4323-a360-486a71842b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-154caa2d-3482-4120-94c8-22dbaa8948b5', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e8ea07-2121-4257-9f66-d4d8b4d1b668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:27 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Volume volume-154caa2d-3482-4120-94c8-22dbaa8948b5 (154caa2d-3482-4120-94c8-22dbaa8948b5): created successfully
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e8ea07-2121-4257-9f66-d4d8b4d1b668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Flow 'volume_create_manager' (e16c4fbc-7b12-488e-832d-ddaaa0e82819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:27 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bb08ba37-a7fd-4af6-b511-c65f1af07e8b tempest-VolumesNegativeTest-88650166 None] Created volume successfully.
Jul 03 23:57:27 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948" returned: 0 in 0.948s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f03839df-f979-41fd-af01-0c77478be527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:57:27 devstack sudo[94632]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd3043f-0e15-46e7-b7e5-5032062427df]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-99cf6576-6f59-4f5e-9a48-f93ba079bc46" returned: 0 in 0.815s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Lock "cinder-quobyte-99cf6576-6f59-4f5e-9a48-f93ba079bc46" released by "delete_volume" :: held 2.631s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Created reservations ['a2fa774b-d2f7-4f32-8828-a3c47f634d5b', '1bf5b785-735d-47c2-b951-ac8154cc84b8', 'ac57d14f-b59b-4406-a7ad-4c228831b03a', '2f2d3013-18c1-4e5a-ba77-28936ec660e2'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:27 devstack sudo[94639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527
Jul 03 23:57:27 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:27 devstack sudo[94641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:57:27 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:28 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.102s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:28 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:57:28 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Deleted volume successfully.
Jul 03 23:57:28 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-43fc158a-ea90-4280-baed-365bb0978b01 tempest-VolumesImageMetadata-442901315 None] Lock "cinder-99cf6576-6f59-4f5e-9a48-f93ba079bc46-delete_volume" released by "delete_volume" :: held 4.163s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:28 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527" returned: 0 in 1.454s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:28 devstack sudo[94694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948
Jul 03 23:57:28 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:30 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948" returned: 0 in 1.136s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:30 devstack sudo[94710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948
Jul 03 23:57:30 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:30 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527.9cb5d383-ed46-43fd-9acb-7bf79f252948" returned: 0 in 0.934s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] Lock "cinder-quobyte-9cb5d383-ed46-43fd-9acb-7bf79f252948" released by "_delete_snapshot" :: held 4.635s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] Lock "cinder-quobyte-f03839df-f979-41fd-af01-0c77478be527" released by "delete_snapshot" :: held 4.668s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:31 devstack cinder-volume[86650]: WARNING cinder.quota [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-105068230 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-105068230, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:57:31 devstack cinder-volume[86650]: WARNING cinder.quota [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-105068230 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-105068230, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:57:31 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] Created reservations ['8cf3703c-80aa-4ca8-9759-be2e08c0603b', '495645f6-8a52-4179-a44c-99097cbb3aa4', '156a5f19-9bef-496b-94e6-6c81a926316a', 'bf420407-8f55-4d12-ab77-c009d7c7d48d'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:31 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c8a21b1d-10fe-4cde-9ca6-333abed7c20d tempest-GroupSnapshotsV319Test-2104998572 None] group_snapshot 0912a94b-daff-42bf-beed-1ecdbc4a1c4a: deleted successfully
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] Acquiring lock "cinder-quobyte-f03839df-f979-41fd-af01-0c77478be527" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] Lock "cinder-quobyte-f03839df-f979-41fd-af01-0c77478be527" acquired by "delete_volume" :: waited 0.054s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Flow 'volume_create_manager' (b2fb8684-6896-49ad-aec2-d1fc6aabdf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897013ba-7fae-47ab-a6ad-703fa405f5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9aaf55e-2adb-4dee-abf6-1cb9c5041ddf]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897013ba-7fae-47ab-a6ad-703fa405f5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1391734277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e81461-00d5-496b-9bd6-3878ad9a9c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57daab758d3c4e3cb16bd13043b64a49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:32Z,use_quota=True,user_id='522989c264b24e62baa4fdfc93df398e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef32919-a725-4ea5-b09c-480f7bb863a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef32919-a725-4ea5-b09c-480f7bb863a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c03e861-f354-4053-9235-288a333ed165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c03e861-f354-4053-9235-288a333ed165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73e81461-00d5-496b-9bd6-3878ad9a9c81', 'volume_name': 'volume-73e81461-00d5-496b-9bd6-3878ad9a9c81', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feecc5e5-60b2-4cb4-98b5-1007a4199993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feecc5e5-60b2-4cb4-98b5-1007a4199993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a6c6f6-6991-4a40-b0b5-1586d50fcc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:32 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Volume 73e81461-00d5-496b-9bd6-3878ad9a9c81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73e81461-00d5-496b-9bd6-3878ad9a9c81', 'volume_size': 1}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1391734277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e81461-00d5-496b-9bd6-3878ad9a9c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57daab758d3c4e3cb16bd13043b64a49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:32Z,use_quota=True,user_id='522989c264b24e62baa4fdfc93df398e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Creating volume 73e81461-00d5-496b-9bd6-3878ad9a9c81 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:57:32 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:57:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:32 devstack sudo[94725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527
Jul 03 23:57:32 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:32 devstack sudo[94727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 1073741824
Jul 03 23:57:32 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:33 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527" returned: 0 in 1.232s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:33 devstack sudo[94738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527
Jul 03 23:57:33 devstack sudo[94738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:34 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 1073741824" returned: 0 in 1.398s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:34 devstack sudo[94740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81
Jul 03 23:57:34 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:34 devstack sudo[94738]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f03839df-f979-41fd-af01-0c77478be527" returned: 0 in 1.157s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] Lock "cinder-quobyte-f03839df-f979-41fd-af01-0c77478be527" released by "delete_volume" :: held 2.537s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:35 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] Created reservations ['5ba6abab-97d3-4294-b95d-29b76772e1a3'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:35 devstack cinder-volume[86650]: WARNING cinder.quota [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-105068230 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-105068230, it is now deprecated. Please use the default quota class for default quota.
Jul 03 23:57:35 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] Created reservations ['58dfc7ee-62ec-40f4-aeeb-86f8e254443f', '8ed94c12-6afc-4831-ad64-161062dd4d43', '87f94b3e-e77b-47b3-9a64-a3c785ac6877', '9bb4a99c-20b2-4280-bf82-a628d31661cb'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:57:35 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81" returned: 0 in 1.355s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] <== create_volume: return (2854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:57:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.857s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a6c6f6-6991-4a40-b0b5-1586d50fcc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73e81461-00d5-496b-9bd6-3878ad9a9c81', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02665764-b4b9-41c8-b0b6-5da736841c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:35 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Volume volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 (73e81461-00d5-496b-9bd6-3878ad9a9c81): created successfully
Jul 03 23:57:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02665764-b4b9-41c8-b0b6-5da736841c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Flow 'volume_create_manager' (b2fb8684-6896-49ad-aec2-d1fc6aabdf9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:35 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-a0e7ec48-079a-4e1a-9bd1-42dd9d098c3a tempest-VolumesCloneTest-976226803 None] Created volume successfully.
Jul 03 23:57:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:35 devstack sudo[94747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:57:35 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:36 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.289s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:36 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:57:36 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-40fbce9a-bdfb-4a04-8e3f-b326470d1998 tempest-GroupSnapshotsV319Test-2104998572 None] Delete group completed successfully.
Jul 03 23:57:37 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:57:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Flow 'volume_create_manager' (98844aff-9bcc-4918-a030-3788af062125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:57:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1488876-cecb-418c-aea8-0af7faf42c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1488876-cecb-418c-aea8-0af7faf42c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1864967950',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70b66a5-67d7-4bf5-82cb-de08112b9fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57daab758d3c4e3cb16bd13043b64a49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:57:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=73e81461-00d5-496b-9bd6-3878ad9a9c81,status='creating',terminated_at=None,updated_at=2026-07-03T21:57:38Z,use_quota=True,user_id='522989c264b24e62baa4fdfc93df398e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5cc91e1-4daa-4416-8258-b86b712d9bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5cc91e1-4daa-4416-8258-b86b712d9bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5efed8-900a-4636-ae28-0015c1cbccd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d5efed8-900a-4636-ae28-0015c1cbccd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c70b66a5-67d7-4bf5-82cb-de08112b9fe4', 'volume_name': 'volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4', 'volume_size': 2, 'source_volid': '73e81461-00d5-496b-9bd6-3878ad9a9c81', 'source_volstatus': 'available'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6891332-5b26-4918-b8e9-96f22fd02901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6891332-5b26-4918-b8e9-96f22fd02901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:57:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6d2139-c731-476b-b843-16be87d53e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:57:38 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Volume c70b66a5-67d7-4bf5-82cb-de08112b9fe4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4', 'volume_size': 2, 'source_volid': '73e81461-00d5-496b-9bd6-3878ad9a9c81', 'source_volstatus': 'available'}
Jul 03 23:57:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:38 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Cloning volume 73e81461-00d5-496b-9bd6-3878ad9a9c81 to volume c70b66a5-67d7-4bf5-82cb-de08112b9fe4
Jul 03 23:57:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Creating offline snapshot 941a2431-319a-45e6-9cce-59fd19f4d4d7 of volume 73e81461-00d5-496b-9bd6-3878ad9a9c81 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:57:38 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3fc4cc-c9c4-42c0-a9e1-9246d8aefaae]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:38 devstack sudo[94769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81
Jul 03 23:57:38 devstack sudo[94769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:39 devstack sudo[94769]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81" returned: 0 in 1.160s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:39 devstack sudo[94775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7 1G
Jul 03 23:57:39 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:40 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7 1G" returned: 0 in 1.146s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:40 devstack sudo[94781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7
Jul 03 23:57:40 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:41 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7" returned: 0 in 1.145s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:41 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7 is being set with open permissions: ugo+rw
Jul 03 23:57:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:41 devstack sudo[94787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7
Jul 03 23:57:41 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:42 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7" returned: 0 in 1.142s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:43 devstack sudo[94838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.info
Jul 03 23:57:43 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:44 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.info" returned: 0 in 1.477s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:44 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.info is being set with open permissions: ugo+rw
Jul 03 23:57:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:44 devstack sudo[94899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.info
Jul 03 23:57:44 devstack sudo[94899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:45 devstack sudo[94899]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.info" returned: 0 in 0.923s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Acquiring lock "cinder-quobyte-c70b66a5-67d7-4bf5-82cb-de08112b9fe4" by "_copy_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Lock "cinder-quobyte-c70b66a5-67d7-4bf5-82cb-de08112b9fe4" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] snapshot: 941a2431-319a-45e6-9cce-59fd19f4d4d7, volume: c70b66a5-67d7-4bf5-82cb-de08112b9fe4,  {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 23:57:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:57:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:57:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:57:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:57:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:57:45 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f77e34-a4d9-43d7-8dc1-c52921ab09c1]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:45 devstack sudo[94922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7
Jul 03 23:57:45 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:46 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7" returned: 0 in 0.896s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73e81461-00d5-496b-9bd6-3878ad9a9c81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:57:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] will copy from snapshot at /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 23:57:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Creating direct copy from snapshot {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 23:57:46 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[32deeeb6-a165-4c70-8f38-93a3db37fa12]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:46 devstack sudo[94929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81
Jul 03 23:57:46 devstack sudo[94929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:47 devstack sudo[94929]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81" returned: 0 in 0.990s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:47 devstack cinder-volume[86650]: DEBUG cinder.utils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Path /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4 not found in is_blk_device check {{(pid=86650) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 23:57:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:47 devstack sudo[94934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4
Jul 03 23:57:47 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:52 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=71,cinder:INSERT=26,cinder:UPDATE=75,cinder:DELETE=6 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:57:52 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=73,cinder:UPDATE=81,cinder:INSERT=24,cinder:DELETE=4 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:57:55 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4" returned: 0 in 7.679s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:55 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5c892d-2937-41e5-8e51-7340d9a90a6b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:55 devstack sudo[94972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81
Jul 03 23:57:55 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:56 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81" returned: 0 in 1.051s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:56 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Image conversion details: src /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81, size 1024.00 MB, duration 7.68 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4 {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 23:57:56 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Converted 1024.00 MB image at 133.33 MB/s
Jul 03 23:57:56 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4 is being set with open permissions: ugo+rw
Jul 03 23:57:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:56 devstack sudo[94985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4
Jul 03 23:57:56 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:57 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4" returned: 0 in 0.892s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:57 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Lock "cinder-quobyte-c70b66a5-67d7-4bf5-82cb-de08112b9fe4" released by "_copy_volume_from_snapshot" :: held 11.637s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:57:57 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Acquiring lock "cinder-quobyte-941a2431-319a-45e6-9cce-59fd19f4d4d7" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:57:57 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Lock "cinder-quobyte-941a2431-319a-45e6-9cce-59fd19f4d4d7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:57:57 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Deleting offline snapshot 941a2431-319a-45e6-9cce-59fd19f4d4d7 of volume 73e81461-00d5-496b-9bd6-3878ad9a9c81 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:57:57 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] snapshot_file for this snap is: volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:57:57 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[623e0bb4-e7db-4814-ba77-66e815845bfe]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:57 devstack sudo[95003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7
Jul 03 23:57:57 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:58 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7" returned: 0 in 0.935s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73e81461-00d5-496b-9bd6-3878ad9a9c81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:57:58 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87f4892-3505-45e2-a3be-01d8343f9122]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:57:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:58 devstack sudo[95013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81
Jul 03 23:57:58 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:57:59 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root
Jul 03 23:57:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81" returned: 0 in 1.258s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:57:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:57:59 devstack sudo[95037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7
Jul 03 23:57:59 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:00 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7" returned: 0 in 1.138s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:00 devstack sudo[95045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7
Jul 03 23:58:00 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:01 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81.941a2431-319a-45e6-9cce-59fd19f4d4d7" returned: 0 in 1.009s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Lock "cinder-quobyte-941a2431-319a-45e6-9cce-59fd19f4d4d7" released by "_delete_snapshot" :: held 4.485s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.536s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea6d2139-c731-476b-b843-16be87d53e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4', 'volume_size': 2, 'source_volid': '73e81461-00d5-496b-9bd6-3878ad9a9c81', 'source_volstatus': 'available'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df13736-24ec-47ca-8751-9899b9ae39e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:01 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Volume volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4 (c70b66a5-67d7-4bf5-82cb-de08112b9fe4): created successfully
Jul 03 23:58:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df13736-24ec-47ca-8751-9899b9ae39e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Flow 'volume_create_manager' (98844aff-9bcc-4918-a030-3788af062125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:01 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e7c3c28e-d183-4d96-8ca8-bcb50031bf6c tempest-VolumesCloneTest-976226803 None] Created volume successfully.
Jul 03 23:58:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Acquiring lock "cinder-c70b66a5-67d7-4bf5-82cb-de08112b9fe4-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Lock "cinder-c70b66a5-67d7-4bf5-82cb-de08112b9fe4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Acquiring lock "cinder-quobyte-c70b66a5-67d7-4bf5-82cb-de08112b9fe4" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Lock "cinder-quobyte-c70b66a5-67d7-4bf5-82cb-de08112b9fe4" acquired by "delete_volume" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:02 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb299b1-d29d-405a-ba95-3538e5ec045b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:02 devstack sudo[95051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4
Jul 03 23:58:02 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:03 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4" returned: 0 in 0.968s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:03 devstack sudo[95058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4
Jul 03 23:58:03 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:04 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c70b66a5-67d7-4bf5-82cb-de08112b9fe4" returned: 0 in 0.807s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Lock "cinder-quobyte-c70b66a5-67d7-4bf5-82cb-de08112b9fe4" released by "delete_volume" :: held 1.843s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:04 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Created reservations ['9df41c94-d619-4f15-adb1-b976a4b2d989', '505744ee-13f1-4457-929e-49178fc8cdad', '609fec8b-520a-4614-8407-6829910c40e7', '31b636b8-5245-438d-8a4d-1e3d5fb1a647'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:04 devstack sudo[95061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:58:04 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Acquiring lock "cinder-73e81461-00d5-496b-9bd6-3878ad9a9c81-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Lock "cinder-73e81461-00d5-496b-9bd6-3878ad9a9c81-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Acquiring lock "cinder-quobyte-73e81461-00d5-496b-9bd6-3878ad9a9c81" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Lock "cinder-quobyte-73e81461-00d5-496b-9bd6-3878ad9a9c81" acquired by "delete_volume" :: waited 0.037s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:04 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e81e65-ab8a-40fe-b1e9-5a173f0ebfc5]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:05 devstack sudo[95063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81
Jul 03 23:58:05 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:05 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.228s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:05 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:05 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Deleted volume successfully.
Jul 03 23:58:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-94411595-6b12-433e-b628-b441d66a6f11 tempest-VolumesCloneTest-976226803 None] Lock "cinder-c70b66a5-67d7-4bf5-82cb-de08112b9fe4-delete_volume" released by "delete_volume" :: held 3.375s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:06 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81" returned: 0 in 1.237s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:06 devstack sudo[95069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81
Jul 03 23:58:06 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:07 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73e81461-00d5-496b-9bd6-3878ad9a9c81" returned: 0 in 1.010s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Lock "cinder-quobyte-73e81461-00d5-496b-9bd6-3878ad9a9c81" released by "delete_volume" :: held 2.394s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Acquiring lock "cinder-154caa2d-3482-4120-94c8-22dbaa8948b5-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:07 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Created reservations ['3dee58a4-7acf-4b24-aa41-98c099c6bb81', '800ccec9-728b-428d-9bda-77e2efee392f', '6bdc6399-e31f-4ba3-8429-cc6d1c9b967b', 'e3d600f1-39f4-488f-9d47-9d2b2097a9b9'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Lock "cinder-154caa2d-3482-4120-94c8-22dbaa8948b5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Acquiring lock "cinder-quobyte-154caa2d-3482-4120-94c8-22dbaa8948b5" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Lock "cinder-quobyte-154caa2d-3482-4120-94c8-22dbaa8948b5" acquired by "delete_volume" :: waited 0.030s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:07 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4f0622-555a-4308-a432-f319dc0d843a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-154caa2d-3482-4120-94c8-22dbaa8948b5 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:07 devstack sudo[95075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:58:07 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:07 devstack sudo[95074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-154caa2d-3482-4120-94c8-22dbaa8948b5
Jul 03 23:58:07 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:08 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-ca73441b-326c-4251-96b6-72a0929e68b4 req-11c782d3-a07b-4995-89de-78a9628cbf48 tempest-AttachVolumeNegativeTest-608528329 None] Terminate volume connection completed successfully.
Jul 03 23:58:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-ca73441b-326c-4251-96b6-72a0929e68b4 req-11c782d3-a07b-4995-89de-78a9628cbf48 tempest-AttachVolumeNegativeTest-608528329 None] Deleting attachment 20c15dbc-cf8b-4a60-beca-fecb0f4e7ac5. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:58:08 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-154caa2d-3482-4120-94c8-22dbaa8948b5" returned: 0 in 1.104s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-154caa2d-3482-4120-94c8-22dbaa8948b5 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:08 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.059s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:08 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:08 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Deleted volume successfully.
Jul 03 23:58:08 devstack sudo[95086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-154caa2d-3482-4120-94c8-22dbaa8948b5
Jul 03 23:58:08 devstack sudo[95086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b0131dc1-bbd1-4b8d-884d-8c800e4fceb6 tempest-VolumesCloneTest-976226803 None] Lock "cinder-73e81461-00d5-496b-9bd6-3878ad9a9c81-delete_volume" released by "delete_volume" :: held 4.003s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:09 devstack sudo[95086]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-154caa2d-3482-4120-94c8-22dbaa8948b5" returned: 0 in 0.771s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Lock "cinder-quobyte-154caa2d-3482-4120-94c8-22dbaa8948b5" released by "delete_volume" :: held 1.945s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:09 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Created reservations ['134e1664-ef54-42f5-b823-18c42de93e60', 'ed35b228-6759-452a-832a-174c8f732666', '463e6bdf-0171-4e41-97be-65a0f402e9fb', 'ab014c74-5534-44f7-aeff-d517e1c50021'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:09 devstack sudo[95090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:58:09 devstack sudo[95090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:10 devstack sudo[95090]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.169s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:10 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:10 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Deleted volume successfully.
Jul 03 23:58:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8ca6f420-17ac-42c9-818a-287a062f83d7 tempest-VolumesNegativeTest-88650166 None] Lock "cinder-154caa2d-3482-4120-94c8-22dbaa8948b5-delete_volume" released by "delete_volume" :: held 3.523s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:14 devstack sudo[95127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:58:14 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Flow 'volume_create_manager' (397e1e92-e81d-416a-83cb-7b3ab3899266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc1b83d-6053-4516-81bc-e386d9dfa694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abc1b83d-6053-4516-81bc-e386d9dfa694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-726896185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c7cabb-acaa-45b6-9952-6a19c390f455,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13cb11ee047f4009a814166bbbbb44fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:15Z,use_quota=True,user_id='bb4b7a6931f44c3690dd5d168a73823a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecec8eab-d1c0-4f71-951c-6335dcced476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecec8eab-d1c0-4f71-951c-6335dcced476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2760b322-d941-478e-b6fe-f2aa97892fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2760b322-d941-478e-b6fe-f2aa97892fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33c7cabb-acaa-45b6-9952-6a19c390f455', 'volume_name': 'volume-33c7cabb-acaa-45b6-9952-6a19c390f455', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7473b404-4083-4941-b088-468aaf79ca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7473b404-4083-4941-b088-468aaf79ca78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91bdea10-80a7-4423-a9b2-52453a9445e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:14 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Volume 33c7cabb-acaa-45b6-9952-6a19c390f455: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33c7cabb-acaa-45b6-9952-6a19c390f455', 'volume_size': 1}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-726896185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c7cabb-acaa-45b6-9952-6a19c390f455,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13cb11ee047f4009a814166bbbbb44fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:15Z,use_quota=True,user_id='bb4b7a6931f44c3690dd5d168a73823a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Creating volume 33c7cabb-acaa-45b6-9952-6a19c390f455 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:58:14 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:58:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33c7cabb-acaa-45b6-9952-6a19c390f455 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:14 devstack sudo[95129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33c7cabb-acaa-45b6-9952-6a19c390f455 1073741824
Jul 03 23:58:14 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:15 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.048s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:58:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 28 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:58:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:58:16 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33c7cabb-acaa-45b6-9952-6a19c390f455 1073741824" returned: 0 in 1.420s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33c7cabb-acaa-45b6-9952-6a19c390f455 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:16 devstack sudo[95136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33c7cabb-acaa-45b6-9952-6a19c390f455
Jul 03 23:58:16 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:17 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33c7cabb-acaa-45b6-9952-6a19c390f455" returned: 0 in 0.790s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:17 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] <== create_volume: return (2266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:58:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.268s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91bdea10-80a7-4423-a9b2-52453a9445e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33c7cabb-acaa-45b6-9952-6a19c390f455', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b6ecb4-102c-4ee8-8960-23a069845d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:17 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Volume volume-33c7cabb-acaa-45b6-9952-6a19c390f455 (33c7cabb-acaa-45b6-9952-6a19c390f455): created successfully
Jul 03 23:58:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46b6ecb4-102c-4ee8-8960-23a069845d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Flow 'volume_create_manager' (397e1e92-e81d-416a-83cb-7b3ab3899266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:17 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-36cefc1c-8c8d-4c65-bd9e-8f24d84351b5 tempest-VolumesGetTest-572136402 None] Created volume successfully.
Jul 03 23:58:18 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Flow 'volume_create_manager' (a6ae3a28-48d2-4f72-b2c8-f0f485687783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d1b59c-15d5-418d-8114-ae84cbcb10b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4d1b59c-15d5-418d-8114-ae84cbcb10b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1227281483',display_name='tempest-VolumesGetTest-Volume-1184859074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4741d6a8-682b-412c-a4f1-cb18fcd6609f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cb11ee047f4009a814166bbbbb44fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:19Z,use_quota=True,user_id='bb4b7a6931f44c3690dd5d168a73823a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3d5a78-22b4-4450-9f65-f284ba7f3109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d3d5a78-22b4-4450-9f65-f284ba7f3109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f849808-516e-4aa0-9c25-c3a37d448e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f849808-516e-4aa0-9c25-c3a37d448e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4741d6a8-682b-412c-a4f1-cb18fcd6609f', 'volume_name': 'volume-4741d6a8-682b-412c-a4f1-cb18fcd6609f', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9469bc6-904f-456a-9d6c-585b6b4762ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9469bc6-904f-456a-9d6c-585b6b4762ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052640c3-0a35-437d-a11e-5070325ea8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:19 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Volume 4741d6a8-682b-412c-a4f1-cb18fcd6609f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4741d6a8-682b-412c-a4f1-cb18fcd6609f', 'volume_size': 1}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:18Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1227281483',display_name='tempest-VolumesGetTest-Volume-1184859074',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4741d6a8-682b-412c-a4f1-cb18fcd6609f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cb11ee047f4009a814166bbbbb44fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:19Z,use_quota=True,user_id='bb4b7a6931f44c3690dd5d168a73823a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Creating volume 4741d6a8-682b-412c-a4f1-cb18fcd6609f {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:58:19 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:58:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4741d6a8-682b-412c-a4f1-cb18fcd6609f 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:19 devstack sudo[95139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4741d6a8-682b-412c-a4f1-cb18fcd6609f 1073741824
Jul 03 23:58:19 devstack sudo[95139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:20 devstack sudo[95139]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4741d6a8-682b-412c-a4f1-cb18fcd6609f 1073741824" returned: 0 in 1.340s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4741d6a8-682b-412c-a4f1-cb18fcd6609f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:20 devstack sudo[95146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4741d6a8-682b-412c-a4f1-cb18fcd6609f
Jul 03 23:58:20 devstack sudo[95146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:21 devstack sudo[95146]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4741d6a8-682b-412c-a4f1-cb18fcd6609f" returned: 0 in 0.966s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] <== create_volume: return (2375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:58:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.380s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052640c3-0a35-437d-a11e-5070325ea8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4741d6a8-682b-412c-a4f1-cb18fcd6609f', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808f0768-a711-4f2d-8178-769d58d71835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:21 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Volume volume-4741d6a8-682b-412c-a4f1-cb18fcd6609f (4741d6a8-682b-412c-a4f1-cb18fcd6609f): created successfully
Jul 03 23:58:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808f0768-a711-4f2d-8178-769d58d71835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Flow 'volume_create_manager' (a6ae3a28-48d2-4f72-b2c8-f0f485687783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:21 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3a097b68-4ee8-414c-b11a-c4922e515fa9 tempest-VolumesGetTest-572136402 None] Created volume successfully.
Jul 03 23:58:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Acquiring lock "cinder-4741d6a8-682b-412c-a4f1-cb18fcd6609f-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Lock "cinder-4741d6a8-682b-412c-a4f1-cb18fcd6609f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Acquiring lock "cinder-quobyte-4741d6a8-682b-412c-a4f1-cb18fcd6609f" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-4741d6a8-682b-412c-a4f1-cb18fcd6609f" acquired by "delete_volume" :: waited 0.026s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:22 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4995bebd-f009-4474-a3fd-b23a44a6b86f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4741d6a8-682b-412c-a4f1-cb18fcd6609f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:22 devstack sudo[95149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4741d6a8-682b-412c-a4f1-cb18fcd6609f
Jul 03 23:58:22 devstack sudo[95149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Flow 'volume_create_manager' (75702d7b-1ee2-490b-a8b0-760ce911552d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a5db11-caa0-4bea-b34b-9c8790dde066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45a5db11-caa0-4bea-b34b-9c8790dde066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-687919741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15eb221a-b3cd-43e3-bd55-3c72c8fb0372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070f2acfcab14df4b6afb30bdf7c1aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:24Z,use_quota=True,user_id='6f022e0e7b124162b648f9584aeb799d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3908ab8a-fdf2-4204-843f-d6d69e24878e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3908ab8a-fdf2-4204-843f-d6d69e24878e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c7c876-0bac-488a-abf7-f5d20f6cb48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c7c876-0bac-488a-abf7-f5d20f6cb48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15eb221a-b3cd-43e3-bd55-3c72c8fb0372', 'volume_name': 'volume-15eb221a-b3cd-43e3-bd55-3c72c8fb0372', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d145f118-070a-4c38-83e4-44d724599937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d145f118-070a-4c38-83e4-44d724599937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18cd8342-b6f7-48a9-a853-0f3c9ff898a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:23 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Volume 15eb221a-b3cd-43e3-bd55-3c72c8fb0372: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15eb221a-b3cd-43e3-bd55-3c72c8fb0372', 'volume_size': 1}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-687919741',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15eb221a-b3cd-43e3-bd55-3c72c8fb0372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070f2acfcab14df4b6afb30bdf7c1aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:24Z,use_quota=True,user_id='6f022e0e7b124162b648f9584aeb799d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Creating volume 15eb221a-b3cd-43e3-bd55-3c72c8fb0372 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:58:23 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-15eb221a-b3cd-43e3-bd55-3c72c8fb0372 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:23 devstack sudo[95149]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4741d6a8-682b-412c-a4f1-cb18fcd6609f" returned: 0 in 1.192s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4741d6a8-682b-412c-a4f1-cb18fcd6609f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:23 devstack sudo[95155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-15eb221a-b3cd-43e3-bd55-3c72c8fb0372 1073741824
Jul 03 23:58:23 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:23 devstack sudo[95156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4741d6a8-682b-412c-a4f1-cb18fcd6609f
Jul 03 23:58:23 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:25 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4741d6a8-682b-412c-a4f1-cb18fcd6609f" returned: 0 in 1.225s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:25 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-4741d6a8-682b-412c-a4f1-cb18fcd6609f" released by "delete_volume" :: held 2.481s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:25 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-15eb221a-b3cd-43e3-bd55-3c72c8fb0372 1073741824" returned: 0 in 1.298s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-15eb221a-b3cd-43e3-bd55-3c72c8fb0372 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:25 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Created reservations ['b636cead-4b08-4c72-bd7b-cfaf644e2600', 'd5841831-1923-4f95-99b4-ce8b89e44565', '643cdd0c-0255-4974-bc28-8d161cb5c1ba', '1d4cb83c-ccf1-4f16-928c-4dfedf628dee'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:25 devstack sudo[95167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-15eb221a-b3cd-43e3-bd55-3c72c8fb0372
Jul 03 23:58:25 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:25 devstack sudo[95169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:58:25 devstack sudo[95169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Acquiring lock "cinder-33c7cabb-acaa-45b6-9952-6a19c390f455-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Lock "cinder-33c7cabb-acaa-45b6-9952-6a19c390f455-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Acquiring lock "cinder-quobyte-33c7cabb-acaa-45b6-9952-6a19c390f455" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-33c7cabb-acaa-45b6-9952-6a19c390f455" acquired by "delete_volume" :: waited 0.039s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:26 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0451aa-1fa9-4ac8-b149-0f62c13ef64e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33c7cabb-acaa-45b6-9952-6a19c390f455 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:26 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-15eb221a-b3cd-43e3-bd55-3c72c8fb0372" returned: 0 in 1.142s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] <== create_volume: return (2529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:58:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.534s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18cd8342-b6f7-48a9-a853-0f3c9ff898a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15eb221a-b3cd-43e3-bd55-3c72c8fb0372', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc21c623-c1d2-4709-a439-4e9849bc7d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:26 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Volume volume-15eb221a-b3cd-43e3-bd55-3c72c8fb0372 (15eb221a-b3cd-43e3-bd55-3c72c8fb0372): created successfully
Jul 03 23:58:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc21c623-c1d2-4709-a439-4e9849bc7d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:26 devstack sudo[95169]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Flow 'volume_create_manager' (75702d7b-1ee2-490b-a8b0-760ce911552d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.075s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:26 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:26 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Deleted volume successfully.
Jul 03 23:58:26 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3127d40c-99a6-467b-ac41-cf35a3ecd1c7 tempest-VolumeQuotasAdminTestJSON-361426033 None] Created volume successfully.
Jul 03 23:58:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e36c2821-b5ee-43da-bcf4-928cc9900b19 tempest-VolumesGetTest-572136402 None] Lock "cinder-4741d6a8-682b-412c-a4f1-cb18fcd6609f-delete_volume" released by "delete_volume" :: held 4.045s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:26 devstack sudo[95173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33c7cabb-acaa-45b6-9952-6a19c390f455
Jul 03 23:58:26 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Acquiring lock "cinder-15eb221a-b3cd-43e3-bd55-3c72c8fb0372-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Lock "cinder-15eb221a-b3cd-43e3-bd55-3c72c8fb0372-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Acquiring lock "cinder-quobyte-15eb221a-b3cd-43e3-bd55-3c72c8fb0372" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Lock "cinder-quobyte-15eb221a-b3cd-43e3-bd55-3c72c8fb0372" acquired by "delete_volume" :: waited 0.030s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:27 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5b9833-ad74-4306-a75d-33a8cddba437]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-15eb221a-b3cd-43e3-bd55-3c72c8fb0372 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:27 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33c7cabb-acaa-45b6-9952-6a19c390f455" returned: 0 in 1.173s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33c7cabb-acaa-45b6-9952-6a19c390f455 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:27 devstack sudo[95180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-15eb221a-b3cd-43e3-bd55-3c72c8fb0372
Jul 03 23:58:27 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:27 devstack sudo[95182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33c7cabb-acaa-45b6-9952-6a19c390f455
Jul 03 23:58:27 devstack sudo[95182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:28 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-15eb221a-b3cd-43e3-bd55-3c72c8fb0372" returned: 0 in 1.016s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-15eb221a-b3cd-43e3-bd55-3c72c8fb0372 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:28 devstack sudo[95182]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33c7cabb-acaa-45b6-9952-6a19c390f455" returned: 0 in 0.914s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:28 devstack sudo[95189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-15eb221a-b3cd-43e3-bd55-3c72c8fb0372
Jul 03 23:58:28 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:28 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-33c7cabb-acaa-45b6-9952-6a19c390f455" released by "delete_volume" :: held 2.154s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:28 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Created reservations ['70bd749a-ab61-4874-a8d8-ae99012d15b4', '6aa059b5-db39-44e8-adb4-1c4c7a106990', '7ee92cdd-4627-42e9-a42f-a0826365a9a1', 'e7cc5614-84aa-4034-8482-41071d172337'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:28 devstack sudo[95191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:58:28 devstack sudo[95191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:29 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-15eb221a-b3cd-43e3-bd55-3c72c8fb0372" returned: 0 in 0.776s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Lock "cinder-quobyte-15eb221a-b3cd-43e3-bd55-3c72c8fb0372" released by "delete_volume" :: held 1.874s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:29 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Created reservations ['dc7a6e68-1a2d-4d40-99b4-d0abe079b378', 'aeee8296-1b7b-4f7e-8e88-ba5fdd44be85', 'c2477904-e219-44c1-ad23-699592648d8b', '46d6e87a-1eec-448d-bd47-005feb6adbae'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:29 devstack sudo[95191]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.789s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:29 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:29 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Deleted volume successfully.
Jul 03 23:58:29 devstack sudo[95195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:58:29 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7a24232c-cc09-424d-b1b5-f18c122cce90 tempest-VolumesGetTest-572136402 None] Lock "cinder-33c7cabb-acaa-45b6-9952-6a19c390f455-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:30 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.038s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:30 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Deleted volume successfully.
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-190718e1-632e-4cb3-a0e3-befbfb995d7b tempest-VolumeQuotasAdminTestJSON-361426033 None] Lock "cinder-15eb221a-b3cd-43e3-bd55-3c72c8fb0372-delete_volume" released by "delete_volume" :: held 3.252s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Flow 'volume_create_manager' (e0f141ee-96e2-4a79-a9c7-d847d750212c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5564f75-8b16-482d-983b-7267cc7db81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5564f75-8b16-482d-983b-7267cc7db81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-111316720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584cbdad-416b-48a0-b51c-653168bb2908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070f2acfcab14df4b6afb30bdf7c1aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:30Z,use_quota=True,user_id='6f022e0e7b124162b648f9584aeb799d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80b9907-4943-4652-8764-30b46eafce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b80b9907-4943-4652-8764-30b46eafce10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7345302-18dd-44bb-afac-3d6e30e19036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7345302-18dd-44bb-afac-3d6e30e19036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '584cbdad-416b-48a0-b51c-653168bb2908', 'volume_name': 'volume-584cbdad-416b-48a0-b51c-653168bb2908', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12acaeb2-cb14-4adf-8ed7-e3f223dc96ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12acaeb2-cb14-4adf-8ed7-e3f223dc96ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de057883-c38d-4be3-9254-9f85cbdee039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:30 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Volume 584cbdad-416b-48a0-b51c-653168bb2908: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-584cbdad-416b-48a0-b51c-653168bb2908', 'volume_size': 1}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-111316720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=584cbdad-416b-48a0-b51c-653168bb2908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='070f2acfcab14df4b6afb30bdf7c1aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:30Z,use_quota=True,user_id='6f022e0e7b124162b648f9584aeb799d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Creating volume 584cbdad-416b-48a0-b51c-653168bb2908 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:58:30 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-584cbdad-416b-48a0-b51c-653168bb2908 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:58:30 devstack sudo[95199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-584cbdad-416b-48a0-b51c-653168bb2908 1073741824
Jul 03 23:58:30 devstack sudo[95199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Flow 'volume_create_manager' (6ab1f00b-b954-4dff-a785-d6d385428ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbe42de-2bb4-46cc-80b4-ffb2f2ae8b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbe42de-2bb4-46cc-80b4-ffb2f2ae8b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-193636134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cb11ee047f4009a814166bbbbb44fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:31Z,use_quota=True,user_id='bb4b7a6931f44c3690dd5d168a73823a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e7a248-eef0-498c-9569-8303329de706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10e7a248-eef0-498c-9569-8303329de706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c92b58c-504e-46af-a992-6123a0a89cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c92b58c-504e-46af-a992-6123a0a89cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce', 'volume_name': 'volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e37657f-90e3-4eb3-bf67-b5f4870892f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e37657f-90e3-4eb3-bf67-b5f4870892f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1b3176-f425-4c42-9140-fe5361f386a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:30 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Volume 7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce', 'volume_size': 1}
Jul 03 23:58:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:32 devstack sudo[95199]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-584cbdad-416b-48a0-b51c-653168bb2908 1073741824" returned: 0 in 1.357s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-584cbdad-416b-48a0-b51c-653168bb2908 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:32 devstack sudo[95210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-584cbdad-416b-48a0-b51c-653168bb2908
Jul 03 23:58:32 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:33 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-584cbdad-416b-48a0-b51c-653168bb2908" returned: 0 in 0.992s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] <== create_volume: return (2409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.411s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.228s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-193636134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cb11ee047f4009a814166bbbbb44fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:31Z,use_quota=True,user_id='bb4b7a6931f44c3690dd5d168a73823a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Creating volume 7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:58:33 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:33 devstack sudo[95229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce 1073741824
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de057883-c38d-4be3-9254-9f85cbdee039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-584cbdad-416b-48a0-b51c-653168bb2908', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:33 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa6fbdc-8153-4384-9ae3-02f0f7896ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:33 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Volume volume-584cbdad-416b-48a0-b51c-653168bb2908 (584cbdad-416b-48a0-b51c-653168bb2908): created successfully
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7aa6fbdc-8153-4384-9ae3-02f0f7896ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Flow 'volume_create_manager' (e0f141ee-96e2-4a79-a9c7-d847d750212c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:33 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e4857cfb-926f-41b1-b4a1-583e871bd856 tempest-VolumeQuotasAdminTestJSON-361426033 None] Created volume successfully.
Jul 03 23:58:34 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce 1073741824" returned: 0 in 1.119s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:34 devstack sudo[95236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce
Jul 03 23:58:34 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:34 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-5c46f500-f086-40a0-a146-98745a2bfdc1 tempest-VolumeQuotasAdminTestJSON-434362528 None] Transfer volume completed successfully.
Jul 03 23:58:35 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce" returned: 0 in 0.810s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:58:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.991s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1b3176-f425-4c42-9140-fe5361f386a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16eaa8db-7a49-465b-b902-301a1a3f2ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:35 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Volume volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce (7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce): created successfully
Jul 03 23:58:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16eaa8db-7a49-465b-b902-301a1a3f2ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Flow 'volume_create_manager' (6ab1f00b-b954-4dff-a785-d6d385428ff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:35 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bfbbe4e2-897f-433f-8e11-55e682fa62d5 tempest-VolumesGetTest-572136402 None] Created volume successfully.
Jul 03 23:58:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Acquiring lock "cinder-584cbdad-416b-48a0-b51c-653168bb2908-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Lock "cinder-584cbdad-416b-48a0-b51c-653168bb2908-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Acquiring lock "cinder-quobyte-584cbdad-416b-48a0-b51c-653168bb2908" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Lock "cinder-quobyte-584cbdad-416b-48a0-b51c-653168bb2908" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:35 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d112489d-fca2-40a2-a88c-4888b5f59981]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-584cbdad-416b-48a0-b51c-653168bb2908 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:35 devstack sudo[95241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-584cbdad-416b-48a0-b51c-653168bb2908
Jul 03 23:58:35 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Flow 'volume_create_manager' (55b8a46c-6ed7-4b0d-b273-a5823b0cccc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a94988-ed9c-4bca-8ee4-6a7ca9a3cd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7a94988-ed9c-4bca-8ee4-6a7ca9a3cd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-842245237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca9d673-7b3b-40c9-9ac8-f367a4626eb5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13cb11ee047f4009a814166bbbbb44fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:37Z,use_quota=True,user_id='bb4b7a6931f44c3690dd5d168a73823a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d8412a-aa03-4674-b32d-a17087bbe2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d8412a-aa03-4674-b32d-a17087bbe2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac7b260-c356-4a6b-9cc1-88b0eb53f2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:37 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac7b260-c356-4a6b-9cc1-88b0eb53f2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bca9d673-7b3b-40c9-9ac8-f367a4626eb5', 'volume_name': 'volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5', 'volume_size': 1, 'source_volid': '7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce', 'source_volstatus': 'available'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1210ad-1cda-46b0-a9da-00eb523e890d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1210ad-1cda-46b0-a9da-00eb523e890d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43936232-55c7-476b-b76e-4a3f72577dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:37 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Volume bca9d673-7b3b-40c9-9ac8-f367a4626eb5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5', 'volume_size': 1, 'source_volid': '7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce', 'source_volstatus': 'available'}
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-584cbdad-416b-48a0-b51c-653168bb2908" returned: 0 in 1.477s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-584cbdad-416b-48a0-b51c-653168bb2908 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:37 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Cloning volume 7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce to volume bca9d673-7b3b-40c9-9ac8-f367a4626eb5
Jul 03 23:58:37 devstack sudo[95282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-584cbdad-416b-48a0-b51c-653168bb2908
Jul 03 23:58:37 devstack sudo[95282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Creating offline snapshot 40fd4f2a-443f-4639-b154-e275521dd785 of volume 7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3870ce08-d523-4113-9400-2414ec1841d0]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:37 devstack sudo[95288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce
Jul 03 23:58:37 devstack sudo[95288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:38 devstack sudo[95288]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce" returned: 0 in 1.137s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:38 devstack sudo[95313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785 1G
Jul 03 23:58:38 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:38 devstack sudo[95282]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-584cbdad-416b-48a0-b51c-653168bb2908" returned: 0 in 1.342s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Lock "cinder-quobyte-584cbdad-416b-48a0-b51c-653168bb2908" released by "delete_volume" :: held 2.871s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:38 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Created reservations ['8c3cb779-da60-4654-b71e-4f7a70b1eee6', '867ac4a0-e305-4e17-8394-4328949affa5', 'a89521b8-b06d-446a-b47f-ccaf851d919b', '7f16afb7-40cf-4f76-8f8b-f05785a1c99d'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:58:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:38 devstack sudo[95325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:58:38 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:40 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785 1G" returned: 0 in 1.745s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:40 devstack sudo[95334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785
Jul 03 23:58:40 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:40 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.579s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:40 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:58:40 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Deleted volume successfully.
Jul 03 23:58:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-73f22e39-6e56-4ec3-a53d-542365f5f875 tempest-VolumeQuotasAdminTestJSON-1862860240 None] Lock "cinder-584cbdad-416b-48a0-b51c-653168bb2908-delete_volume" released by "delete_volume" :: held 4.889s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:41 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785" returned: 0 in 1.462s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:41 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785 is being set with open permissions: ugo+rw
Jul 03 23:58:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:41 devstack sudo[95339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785
Jul 03 23:58:41 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:43 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785" returned: 0 in 1.614s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:43 devstack sudo[95377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.info
Jul 03 23:58:43 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:44 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.info" returned: 0 in 1.379s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:44 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.info is being set with open permissions: ugo+rw
Jul 03 23:58:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:44 devstack sudo[95380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.info
Jul 03 23:58:44 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:45 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.info" returned: 0 in 1.156s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Acquiring lock "cinder-quobyte-bca9d673-7b3b-40c9-9ac8-f367a4626eb5" by "_copy_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-bca9d673-7b3b-40c9-9ac8-f367a4626eb5" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] snapshot: 40fd4f2a-443f-4639-b154-e275521dd785, volume: bca9d673-7b3b-40c9-9ac8-f367a4626eb5,  {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 03 23:58:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:58:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:58:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:58:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:58:46 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3476b1-2eb5-4bda-b54d-9160af07b24e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:46 devstack sudo[95385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785
Jul 03 23:58:46 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:47 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785" returned: 0 in 1.398s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:58:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] will copy from snapshot at /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 03 23:58:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Creating direct copy from snapshot {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 03 23:58:47 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1ac13e-c8ef-45b2-845c-6ed2d291a3d9]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:47 devstack sudo[95391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce
Jul 03 23:58:47 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:49 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce" returned: 0 in 1.504s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:49 devstack cinder-volume[86650]: DEBUG cinder.utils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Path /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5 not found in is_blk_device check {{(pid=86650) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 03 23:58:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:49 devstack sudo[95398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5
Jul 03 23:58:49 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:52 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:58:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Flow 'volume_create_manager' (1e7728a2-856d-4507-a0e9-4118033bd95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589b16ab-13b6-4c5b-9e32-c736776c6812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589b16ab-13b6-4c5b-9e32-c736776c6812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-733299270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdfd1048-ecf7-4210-8279-4f67af056146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2f1afb430c4e55983fadd10cc5cee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:53Z,use_quota=True,user_id='ed729abaab19489dab7ef90ad27a05ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7438d6c0-fd73-4bb4-b6d9-cc66f0a42244),volume_type_id=7438d6c0-fd73-4bb4-b6d9-cc66f0a42244)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd54f3d-ff6d-40a0-9e88-f1af46bb406c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd54f3d-ff6d-40a0-9e88-f1af46bb406c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228932a9-0a25-43dd-8c91-45e379efee4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228932a9-0a25-43dd-8c91-45e379efee4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdfd1048-ecf7-4210-8279-4f67af056146', 'volume_name': 'volume-bdfd1048-ecf7-4210-8279-4f67af056146', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c8a7ff-d4f9-43ee-8a61-a80e8262e1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c8a7ff-d4f9-43ee-8a61-a80e8262e1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8404f61-9baf-49bd-88e3-7045b72d064a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:52 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Volume bdfd1048-ecf7-4210-8279-4f67af056146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdfd1048-ecf7-4210-8279-4f67af056146', 'volume_size': 1}
Jul 03 23:58:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:54 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=77,cinder:SELECT=58,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:58:54 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=77,cinder:SELECT=49,cinder:INSERT=16,cinder:DELETE=8 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:58:54 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:58:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Flow 'volume_create_manager' (a421e50b-65b9-4d58-80e9-dd3c547ba80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ce3661-5559-4573-9d8f-9a42bc6ad5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ce3661-5559-4573-9d8f-9a42bc6ad5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2043811197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f698d94-2755-4333-ba15-d91bb7438166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2f1afb430c4e55983fadd10cc5cee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:55Z,use_quota=True,user_id='ed729abaab19489dab7ef90ad27a05ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1993dd2-cb76-4772-8a9c-1fe2c12348ba),volume_type_id=f1993dd2-cb76-4772-8a9c-1fe2c12348ba)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e9b5e7-0bf0-4704-ac92-94990aa5a223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e9b5e7-0bf0-4704-ac92-94990aa5a223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d6036b-f715-4a9e-b84c-539993c0ef0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5d6036b-f715-4a9e-b84c-539993c0ef0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f698d94-2755-4333-ba15-d91bb7438166', 'volume_name': 'volume-3f698d94-2755-4333-ba15-d91bb7438166', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7016ca1-82fd-4445-9817-0a54ee12c791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7016ca1-82fd-4445-9817-0a54ee12c791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5444b805-51f8-4ce6-95d8-7adf32087e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:54 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Volume 3f698d94-2755-4333-ba15-d91bb7438166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f698d94-2755-4333-ba15-d91bb7438166', 'volume_size': 1}
Jul 03 23:58:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:56 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:58:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Flow 'volume_create_manager' (ccd0f172-8092-45e8-994c-26c6a023f7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb14392-0711-4d7d-8139-d4e3430f6d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cb14392-0711-4d7d-8139-d4e3430f6d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-725358385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c881a100-e11c-47e9-a4e9-55f7ccf590fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2f1afb430c4e55983fadd10cc5cee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:56Z,use_quota=True,user_id='ed729abaab19489dab7ef90ad27a05ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cf2e8a-dc6b-48c1-9292-72267d609e2d),volume_type_id=47cf2e8a-dc6b-48c1-9292-72267d609e2d)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e79d115-aa8a-457b-b116-d079248f1f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e79d115-aa8a-457b-b116-d079248f1f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2e4df1-c307-4624-a3dd-f4a5fb0e822c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:56 devstack cinder-volume[86650]: DEBUG cinder.image.glance [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Creating Keystone auth plugin from conf {{(pid=86650) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 23:58:56 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5" returned: 0 in 7.754s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:56 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac81867d-c2b3-4d27-a032-4aef2075d114]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:56 devstack sudo[95435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce
Jul 03 23:58:56 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca2e4df1-c307-4624-a3dd-f4a5fb0e822c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c881a100-e11c-47e9-a4e9-55f7ccf590fb', 'volume_name': 'volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb', 'volume_size': 1, 'image_id': '23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1202982521', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c2f1afb430c4e55983fadd10cc5cee1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a', 'created_at': datetime.datetime(2026, 7, 3, 21, 58, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 58, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000c46ed0>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752214e7-ab4d-4851-8e77-3aca7447193c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752214e7-ab4d-4851-8e77-3aca7447193c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31df4916-a356-417d-9f96-cff22308daef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:57 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Volume c881a100-e11c-47e9-a4e9-55f7ccf590fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb', 'volume_size': 1, 'image_id': '23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1202982521', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c2f1afb430c4e55983fadd10cc5cee1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a', 'created_at': datetime.datetime(2026, 7, 3, 21, 58, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 58, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000c46ed0>}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Trying to clone c881a100-e11c-47e9-a4e9-55f7ccf590fb from image 23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a at location (None, [{'url': 'file:///opt/stack/data/glance/images/23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a', 'metadata': {}}]). {{(pid=86650) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Flow 'volume_create_manager' (5f5b03c7-897e-462e-a521-ffc5bac95269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf18a379-2c1b-4a73-9992-3475102eb889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf18a379-2c1b-4a73-9992-3475102eb889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1181789596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc76f33e-047b-4c69-b39e-04c200ec7335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e51754560224436b037ab01d2eb5267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:57Z,use_quota=True,user_id='dbf4355975b6422d94b5e9de4c3e1634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8e93dd-6e90-4661-af5b-eda355b5700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8e93dd-6e90-4661-af5b-eda355b5700e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69729752-9f7a-46f7-a94e-5aef83e12580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69729752-9f7a-46f7-a94e-5aef83e12580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc76f33e-047b-4c69-b39e-04c200ec7335', 'volume_name': 'volume-bc76f33e-047b-4c69-b39e-04c200ec7335', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a1ae10-17e2-4b0c-b53d-8054272f33fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a1ae10-17e2-4b0c-b53d-8054272f33fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffac6527-bfcc-4df4-8926-d6269b271f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:58:57 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Volume bc76f33e-047b-4c69-b39e-04c200ec7335: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc76f33e-047b-4c69-b39e-04c200ec7335', 'volume_size': 1}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:58:57 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce" returned: 0 in 1.065s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Image conversion details: src /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce, size 1024.00 MB, duration 7.76 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5 {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 23:58:57 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Converted 1024.00 MB image at 132.04 MB/s
Jul 03 23:58:57 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5 is being set with open permissions: ugo+rw
Jul 03 23:58:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:57 devstack sudo[95440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5
Jul 03 23:58:57 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:58 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5" returned: 0 in 0.752s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-bca9d673-7b3b-40c9-9ac8-f367a4626eb5" released by "_copy_volume_from_snapshot" :: held 12.685s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:58:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Acquiring lock "cinder-quobyte-40fd4f2a-443f-4639-b154-e275521dd785" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:58:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-40fd4f2a-443f-4639-b154-e275521dd785" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:58:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Deleting offline snapshot 40fd4f2a-443f-4639-b154-e275521dd785 of volume 7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 03 23:58:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] snapshot_file for this snap is: volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 03 23:58:58 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ecf9b8-1248-4858-a81b-4e919d7cf259]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:58 devstack sudo[95443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785
Jul 03 23:58:58 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:58:59 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root
Jul 03 23:58:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785" returned: 0 in 0.802s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:58:59 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 03 23:58:59 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec93547a-e78f-4319-9806-4ca5676f8fb5]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:58:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:58:59 devstack sudo[95449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce
Jul 03 23:58:59 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:00 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce" returned: 0 in 0.770s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:00 devstack sudo[95454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785
Jul 03 23:59:00 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:00 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a__ws15l_ldevstack@QuobyteHD, size 20.69 MB, duration 3.38 sec {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 23:59:00 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Image download 20.69 MB at 6.12 MB/s
Jul 03 23:59:00 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae6a166-8b6f-4559-a174-b5f8b6b8fb11]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a__ws15l_ldevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:00 devstack sudo[95456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a__ws15l_ldevstack@QuobyteHD
Jul 03 23:59:00 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:01 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785" returned: 0 in 0.885s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:01 devstack sudo[95464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785
Jul 03 23:59:01 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:01 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a__ws15l_ldevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:01 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Temporary image 23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a is fetched for user ed729abaab19489dab7ef90ad27a05ec. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 23:59:01 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[266bb2a5-ae5d-43a5-b058-e4e509a2fbd9]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a__ws15l_ldevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:01 devstack sudo[95466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a__ws15l_ldevstack@QuobyteHD
Jul 03 23:59:01 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:01 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce.40fd4f2a-443f-4639-b154-e275521dd785" returned: 0 in 0.741s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-40fd4f2a-443f-4639-b154-e275521dd785" released by "_delete_snapshot" :: held 3.319s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.840s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.101s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-733299270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdfd1048-ecf7-4210-8279-4f67af056146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2f1afb430c4e55983fadd10cc5cee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:53Z,use_quota=True,user_id='ed729abaab19489dab7ef90ad27a05ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7438d6c0-fd73-4bb4-b6d9-cc66f0a42244),volume_type_id=7438d6c0-fd73-4bb4-b6d9-cc66f0a42244)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Creating volume bdfd1048-ecf7-4210-8279-4f67af056146 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:59:02 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bdfd1048-ecf7-4210-8279-4f67af056146 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:02 devstack sudo[95472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bdfd1048-ecf7-4210-8279-4f67af056146 1073741824
Jul 03 23:59:02 devstack sudo[95472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43936232-55c7-476b-b76e-4a3f72577dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5', 'volume_size': 1, 'source_volid': '7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce', 'source_volstatus': 'available'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b4f959-f402-4a8f-8ce8-b36f1ccf9722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:02 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Volume volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5 (bca9d673-7b3b-40c9-9ac8-f367a4626eb5): created successfully
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b4f959-f402-4a8f-8ce8-b36f1ccf9722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Flow 'volume_create_manager' (55b8a46c-6ed7-4b0d-b273-a5823b0cccc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:02 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-1c3249f4-6795-4fae-b9d1-ac69d8587a0b tempest-VolumesGetTest-572136402 None] Created volume successfully.
Jul 03 23:59:02 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a__ws15l_ldevstack@QuobyteHD" returned: 0 in 0.861s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:03 devstack sudo[95472]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bdfd1048-ecf7-4210-8279-4f67af056146 1073741824" returned: 0 in 1.042s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bdfd1048-ecf7-4210-8279-4f67af056146 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:03 devstack sudo[95481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bdfd1048-ecf7-4210-8279-4f67af056146
Jul 03 23:59:03 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:03 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bdfd1048-ecf7-4210-8279-4f67af056146" returned: 0 in 0.787s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:03 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:59:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.894s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.048s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:03 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2043811197',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f698d94-2755-4333-ba15-d91bb7438166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2f1afb430c4e55983fadd10cc5cee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:55Z,use_quota=True,user_id='ed729abaab19489dab7ef90ad27a05ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1993dd2-cb76-4772-8a9c-1fe2c12348ba),volume_type_id=f1993dd2-cb76-4772-8a9c-1fe2c12348ba)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:59:03 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Creating volume 3f698d94-2755-4333-ba15-d91bb7438166 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:59:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:03 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:59:04 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3f698d94-2755-4333-ba15-d91bb7438166 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:04 devstack sudo[95485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3f698d94-2755-4333-ba15-d91bb7438166 1073741824
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8404f61-9baf-49bd-88e3-7045b72d064a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdfd1048-ecf7-4210-8279-4f67af056146', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:04 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0573a18f-fcc7-452a-903a-4f8bcaf9cdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:04 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Volume volume-bdfd1048-ecf7-4210-8279-4f67af056146 (bdfd1048-ecf7-4210-8279-4f67af056146): created successfully
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0573a18f-fcc7-452a-903a-4f8bcaf9cdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Flow 'volume_create_manager' (1e7728a2-856d-4507-a0e9-4118033bd95d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Flow 'volume_create_manager' (b6f6ee3f-aaeb-4ecd-bffb-3c8d4a3ac6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a780789c-f603-411f-8ba1-cf9717f36919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:04 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-d45eddc5-dffc-48a2-8097-178f8c195038 tempest-TestInstancesWithCinderVolumes-556844828 None] Created volume successfully.
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a780789c-f603-411f-8ba1-cf9717f36919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-251323966',display_name='tempest-VolumesGetTest-Volume-325248965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b194c229-ec1c-489d-b94a-73d1cc6583ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cb11ee047f4009a814166bbbbb44fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:04Z,use_quota=True,user_id='bb4b7a6931f44c3690dd5d168a73823a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d6ba35-2b09-47be-8b12-117f2de763bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d6ba35-2b09-47be-8b12-117f2de763bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e29b40b-a6f4-4fc8-b7a9-f9365b77825d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e29b40b-a6f4-4fc8-b7a9-f9365b77825d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b194c229-ec1c-489d-b94a-73d1cc6583ba', 'volume_name': 'volume-b194c229-ec1c-489d-b94a-73d1cc6583ba', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea8d4b4-c69e-4295-9cb1-ca25f1c32032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea8d4b4-c69e-4295-9cb1-ca25f1c32032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592044a3-54df-412e-8469-ddd8da13fedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:04 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Volume b194c229-ec1c-489d-b94a-73d1cc6583ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b194c229-ec1c-489d-b94a-73d1cc6583ba', 'volume_size': 1}
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:04 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3f698d94-2755-4333-ba15-d91bb7438166 1073741824" returned: 0 in 0.859s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3f698d94-2755-4333-ba15-d91bb7438166 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:04 devstack sudo[95491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3f698d94-2755-4333-ba15-d91bb7438166
Jul 03 23:59:04 devstack sudo[95491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:05 devstack sudo[95491]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3f698d94-2755-4333-ba15-d91bb7438166" returned: 0 in 0.674s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.149s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1181789596',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc76f33e-047b-4c69-b39e-04c200ec7335,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e51754560224436b037ab01d2eb5267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:57Z,use_quota=True,user_id='dbf4355975b6422d94b5e9de4c3e1634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Creating volume bc76f33e-047b-4c69-b39e-04c200ec7335 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:59:05 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc76f33e-047b-4c69-b39e-04c200ec7335 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:05 devstack sudo[95494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc76f33e-047b-4c69-b39e-04c200ec7335 1073741824
Jul 03 23:59:05 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5444b805-51f8-4ce6-95d8-7adf32087e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f698d94-2755-4333-ba15-d91bb7438166', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7a5f24-238f-46f2-8c22-7557978b78ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:05 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Volume volume-3f698d94-2755-4333-ba15-d91bb7438166 (3f698d94-2755-4333-ba15-d91bb7438166): created successfully
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c7a5f24-238f-46f2-8c22-7557978b78ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Flow 'volume_create_manager' (a421e50b-65b9-4d58-80e9-dd3c547ba80e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:05 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-26ddd9e8-9f91-4451-92fe-45273615e3bd tempest-TestInstancesWithCinderVolumes-556844828 None] Created volume successfully.
Jul 03 23:59:06 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc76f33e-047b-4c69-b39e-04c200ec7335 1073741824" returned: 0 in 0.925s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc76f33e-047b-4c69-b39e-04c200ec7335 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:06 devstack sudo[95500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc76f33e-047b-4c69-b39e-04c200ec7335
Jul 03 23:59:06 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:07 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc76f33e-047b-4c69-b39e-04c200ec7335" returned: 0 in 0.686s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.962s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-725358385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c881a100-e11c-47e9-a4e9-55f7ccf590fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2f1afb430c4e55983fadd10cc5cee1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:58:56Z,use_quota=True,user_id='ed729abaab19489dab7ef90ad27a05ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47cf2e8a-dc6b-48c1-9292-72267d609e2d),volume_type_id=47cf2e8a-dc6b-48c1-9292-72267d609e2d)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Creating volume c881a100-e11c-47e9-a4e9-55f7ccf590fb {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:59:07 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffac6527-bfcc-4df4-8926-d6269b271f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc76f33e-047b-4c69-b39e-04c200ec7335', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:07 devstack sudo[95503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb 1073741824
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164dc783-b240-4102-8be8-071859bfc223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:07 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:07 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Volume volume-bc76f33e-047b-4c69-b39e-04c200ec7335 (bc76f33e-047b-4c69-b39e-04c200ec7335): created successfully
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164dc783-b240-4102-8be8-071859bfc223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Flow 'volume_create_manager' (5f5b03c7-897e-462e-a521-ffc5bac95269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:07 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9c4ef313-4d74-44d1-b6e9-c3bdc41d9410 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Created volume successfully.
Jul 03 23:59:08 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:59:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Flow 'volume_create_manager' (4feb0623-2d4a-4917-ac2c-fa55a5d59497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84808345-4612-4634-aad0-96ecf66c89cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:08 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84808345-4612-4634-aad0-96ecf66c89cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-202199385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc031608-d602-4ec5-94fb-8768eafaf0c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c44b12bcded4a1dbbc99b602500e47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:08Z,use_quota=True,user_id='cf0d08b4f0424ac9980fa4b8c333ae27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ff3165-c92b-400c-9a9e-d83977b7bf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ff3165-c92b-400c-9a9e-d83977b7bf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f076d574-c041-44cd-bc90-c5a5950da2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f076d574-c041-44cd-bc90-c5a5950da2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc031608-d602-4ec5-94fb-8768eafaf0c2', 'volume_name': 'volume-bc031608-d602-4ec5-94fb-8768eafaf0c2', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0744e9a-932b-4f0f-9acc-16f2543c357f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0744e9a-932b-4f0f-9acc-16f2543c357f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70447fe-446b-46a5-b0c4-bb19ec5ce532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:08 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Volume bc031608-d602-4ec5-94fb-8768eafaf0c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc031608-d602-4ec5-94fb-8768eafaf0c2', 'volume_size': 1}
Jul 03 23:59:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb 1073741824" returned: 0 in 1.036s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:08 devstack sudo[95512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb
Jul 03 23:59:08 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:09 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb" returned: 0 in 0.687s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.819s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-251323966',display_name='tempest-VolumesGetTest-Volume-325248965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b194c229-ec1c-489d-b94a-73d1cc6583ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cb11ee047f4009a814166bbbbb44fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:04Z,use_quota=True,user_id='bb4b7a6931f44c3690dd5d168a73823a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Creating volume b194c229-ec1c-489d-b94a-73d1cc6583ba {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:59:09 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b194c229-ec1c-489d-b94a-73d1cc6583ba 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:09 devstack sudo[95516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b194c229-ec1c-489d-b94a-73d1cc6583ba 1073741824
Jul 03 23:59:09 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Attempting download of 23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a ((None, [{'url': 'file:///opt/stack/data/glance/images/23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a', 'metadata': {}}])) to volume c881a100-e11c-47e9-a4e9-55f7ccf590fb. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[794d696c-bbd8-466d-92d1-532c1c412252]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a_k8b3fzoq {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:09 devstack sudo[95518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a_k8b3fzoq
Jul 03 23:59:09 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Acquiring lock "cinder-bc76f33e-047b-4c69-b39e-04c200ec7335-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Lock "cinder-bc76f33e-047b-4c69-b39e-04c200ec7335-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Acquiring lock "cinder-quobyte-bc76f33e-047b-4c69-b39e-04c200ec7335" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Lock "cinder-quobyte-bc76f33e-047b-4c69-b39e-04c200ec7335" acquired by "delete_volume" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccbd535-eb76-4c06-b944-aa74b90df47b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc76f33e-047b-4c69-b39e-04c200ec7335 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:09 devstack sudo[95520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc76f33e-047b-4c69-b39e-04c200ec7335
Jul 03 23:59:09 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:10 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a_k8b3fzoq" returned: 0 in 0.885s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a_k8b3fzoq {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:10 devstack sudo[95536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a_k8b3fzoq
Jul 03 23:59:10 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:10 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b194c229-ec1c-489d-b94a-73d1cc6583ba 1073741824" returned: 0 in 1.158s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b194c229-ec1c-489d-b94a-73d1cc6583ba {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:10 devstack sudo[95538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b194c229-ec1c-489d-b94a-73d1cc6583ba
Jul 03 23:59:10 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:10 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc76f33e-047b-4c69-b39e-04c200ec7335" returned: 0 in 0.929s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc76f33e-047b-4c69-b39e-04c200ec7335 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:10 devstack sudo[95543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc76f33e-047b-4c69-b39e-04c200ec7335
Jul 03 23:59:10 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:10 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a_k8b3fzoq" returned: 1 in 0.837s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a_k8b3fzoq' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:59:10 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9eaca09-c954-435c-9fb7-0ce791f4923f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a__ws15l_ldevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:10 devstack sudo[95548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a__ws15l_ldevstack@QuobyteHD
Jul 03 23:59:10 devstack sudo[95548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:11 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b194c229-ec1c-489d-b94a-73d1cc6583ba" returned: 0 in 0.782s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.990s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.732s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-202199385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc031608-d602-4ec5-94fb-8768eafaf0c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c44b12bcded4a1dbbc99b602500e47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:08Z,use_quota=True,user_id='cf0d08b4f0424ac9980fa4b8c333ae27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Creating volume bc031608-d602-4ec5-94fb-8768eafaf0c2 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:59:11 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc031608-d602-4ec5-94fb-8768eafaf0c2 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592044a3-54df-412e-8469-ddd8da13fedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b194c229-ec1c-489d-b94a-73d1cc6583ba', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:11 devstack sudo[95550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc031608-d602-4ec5-94fb-8768eafaf0c2 1073741824
Jul 03 23:59:11 devstack sudo[95550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56d2e9b-171e-4b21-907e-45458404459d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:11 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Volume volume-b194c229-ec1c-489d-b94a-73d1cc6583ba (b194c229-ec1c-489d-b94a-73d1cc6583ba): created successfully
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f56d2e9b-171e-4b21-907e-45458404459d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Flow 'volume_create_manager' (b6f6ee3f-aaeb-4ecd-bffb-3c8d4a3ac6ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:11 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-cc9a174c-6492-4578-983f-f681a5a02681 tempest-VolumesGetTest-572136402 None] Created volume successfully.
Jul 03 23:59:11 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc76f33e-047b-4c69-b39e-04c200ec7335" returned: 0 in 0.804s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Lock "cinder-quobyte-bc76f33e-047b-4c69-b39e-04c200ec7335" released by "delete_volume" :: held 1.777s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Created reservations ['4235c40f-b7da-4b6c-8736-fd6162f14692', '0cf0331b-311f-473f-b69a-1faf717e3311', '5995a680-c71f-4db6-ad41-6101dc163d00', 'dcf1c3d7-f7b1-4899-a6cf-b4aae326ae42'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:11 devstack sudo[95553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:59:11 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:11 devstack sudo[95548]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a__ws15l_ldevstack@QuobyteHD" returned: 0 in 0.894s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] 23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a was qcow2, converting to raw {{(pid=86650) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a__ws15l_ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:11 devstack sudo[95558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a__ws15l_ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb
Jul 03 23:59:11 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Acquiring lock "cinder-b194c229-ec1c-489d-b94a-73d1cc6583ba-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Lock "cinder-b194c229-ec1c-489d-b94a-73d1cc6583ba-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Acquiring lock "cinder-quobyte-b194c229-ec1c-489d-b94a-73d1cc6583ba" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-b194c229-ec1c-489d-b94a-73d1cc6583ba" acquired by "delete_volume" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:12 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c082f79e-a53f-4054-b66d-4f8157f4666e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b194c229-ec1c-489d-b94a-73d1cc6583ba {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:12 devstack sudo[95564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b194c229-ec1c-489d-b94a-73d1cc6583ba
Jul 03 23:59:12 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:12 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.060s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:12 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:59:12 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Deleted volume successfully.
Jul 03 23:59:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8021ee99-47d8-4f34-8c4d-e7d1988976d6 tempest-VolumeQuotasNegativeTestJSON-315170954 None] Lock "cinder-bc76f33e-047b-4c69-b39e-04c200ec7335-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:12 devstack sudo[95550]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc031608-d602-4ec5-94fb-8768eafaf0c2 1073741824" returned: 0 in 1.556s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc031608-d602-4ec5-94fb-8768eafaf0c2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:12 devstack sudo[95567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc031608-d602-4ec5-94fb-8768eafaf0c2
Jul 03 23:59:12 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:13 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b194c229-ec1c-489d-b94a-73d1cc6583ba" returned: 0 in 1.175s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b194c229-ec1c-489d-b94a-73d1cc6583ba {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:13 devstack sudo[95580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b194c229-ec1c-489d-b94a-73d1cc6583ba
Jul 03 23:59:13 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:13 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc031608-d602-4ec5-94fb-8768eafaf0c2" returned: 0 in 0.867s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] <== create_volume: return (2489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:59:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.498s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70447fe-446b-46a5-b0c4-bb19ec5ce532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc031608-d602-4ec5-94fb-8768eafaf0c2', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434771d7-cf15-45bc-9a69-47445be0e294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:13 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Volume volume-bc031608-d602-4ec5-94fb-8768eafaf0c2 (bc031608-d602-4ec5-94fb-8768eafaf0c2): created successfully
Jul 03 23:59:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (434771d7-cf15-45bc-9a69-47445be0e294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Flow 'volume_create_manager' (4feb0623-2d4a-4917-ac2c-fa55a5d59497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:13 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-d4cc0541-a802-4d45-957a-c996ef028457 tempest-AttachVolumeNegativeTest-608528329 None] Created volume successfully.
Jul 03 23:59:14 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b194c229-ec1c-489d-b94a-73d1cc6583ba" returned: 0 in 0.875s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-b194c229-ec1c-489d-b94a-73d1cc6583ba" released by "delete_volume" :: held 2.111s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Created reservations ['8842451d-69ae-4a39-93fb-7a8509e8678d', 'cb0f9e53-7ab7-4d72-a93b-ea9957c2382f', '4c2e1c36-5aeb-466e-bf69-eebc0afadb39', 'bf98f437-6636-4b8a-87da-c9d98df0bbf3'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:14 devstack sudo[95583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:59:14 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:14 devstack sudo[95585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:59:14 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:14 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a__ws15l_ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb" returned: 0 in 2.773s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a__ws15l_ldevstack@QuobyteHD, size 112.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 23:59:14 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Converted 112.00 MB image at 40.33 MB/s
Jul 03 23:59:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:14 devstack sudo[95587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb 1G
Jul 03 23:59:14 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:15 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.981s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 28 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 03 23:59:15 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.145s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Acquiring lock "cinder-bca9d673-7b3b-40c9-9ac8-f367a4626eb5-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:15 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Deleted volume successfully.
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-10f7dfa5-2c8a-4876-8eb3-97b0ef5ca171 tempest-VolumesGetTest-572136402 None] Lock "cinder-b194c229-ec1c-489d-b94a-73d1cc6583ba-delete_volume" released by "delete_volume" :: held 3.669s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Lock "cinder-bca9d673-7b3b-40c9-9ac8-f367a4626eb5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:15 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb 1G" returned: 0 in 1.173s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Acquiring lock "cinder-quobyte-bca9d673-7b3b-40c9-9ac8-f367a4626eb5" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b1b0c5-d276-402b-8f47-56d616f17e1e]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-bca9d673-7b3b-40c9-9ac8-f367a4626eb5" acquired by "delete_volume" :: waited 0.048s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f0a188-0897-48fa-b23c-67343dc1fca5]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:15 devstack sudo[95597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb
Jul 03 23:59:15 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:16 devstack sudo[95598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5
Jul 03 23:59:16 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:16 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb" returned: 0 in 0.946s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:16 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5" returned: 0 in 1.004s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:16 devstack sudo[95606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb
Jul 03 23:59:16 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:16 devstack sudo[95608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5
Jul 03 23:59:16 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:17 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb" returned: 1 in 0.980s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:59:17 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Downloaded image 23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a ((None, [{'url': 'file:///opt/stack/data/glance/images/23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a', 'metadata': {}}])) to volume c881a100-e11c-47e9-a4e9-55f7ccf590fb successfully. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 23:59:17 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Temporary image 23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a for user ed729abaab19489dab7ef90ad27a05ec is deleted. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 23:59:17 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Marking volume c881a100-e11c-47e9-a4e9-55f7ccf590fb as bootable. {{(pid=86650) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 23:59:17 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Copying metadata from image 23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a to c881a100-e11c-47e9-a4e9-55f7ccf590fb. {{(pid=86650) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 23:59:17 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Creating volume glance metadata for volume c881a100-e11c-47e9-a4e9-55f7ccf590fb backed by image 23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a with: {'image_id': '23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a', 'image_name': 'tempest-scenario-img--1202982521', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86650) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 23:59:17 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bca9d673-7b3b-40c9-9ac8-f367a4626eb5" returned: 0 in 0.939s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-bca9d673-7b3b-40c9-9ac8-f367a4626eb5" released by "delete_volume" :: held 2.019s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31df4916-a356-417d-9f96-cff22308daef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb', 'volume_size': 1, 'image_id': '23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1202982521', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '7c2f1afb430c4e55983fadd10cc5cee1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a', 'created_at': datetime.datetime(2026, 7, 3, 21, 58, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 58, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/23a1316a-9bb9-49ea-9ffd-9b3d3ddd888a/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000c46ed0>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b72c03e-991a-4a72-a78b-613319d62075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:17 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Volume volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb (c881a100-e11c-47e9-a4e9-55f7ccf590fb): created successfully
Jul 03 23:59:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b72c03e-991a-4a72-a78b-613319d62075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Flow 'volume_create_manager' (ccd0f172-8092-45e8-994c-26c6a023f7bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:17 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-218942d9-7d1f-4e27-a843-7aa1f7f0aeab tempest-TestInstancesWithCinderVolumes-556844828 None] Created volume successfully.
Jul 03 23:59:17 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Created reservations ['e732f239-2881-43c2-bf0d-d1705e94d67b', 'bd82df2f-187e-4746-8ea4-484faa00c49d', '0a096929-a2b4-4a1e-877a-4022c4bc6642', '88d596af-7e70-4047-8323-889540cdadd0'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:59:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:18 devstack sudo[95622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:59:18 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-bd1e8650-4c00-4565-bd2b-8877527b42eb req-66586fbe-2927-4eba-a605-cc0f4d3caa3c tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-bd1e8650-4c00-4565-bd2b-8877527b42eb req-66586fbe-2927-4eba-a605-cc0f4d3caa3c tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:18 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1eb79c-e04a-4d64-b243-8863d3c8ada5]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-bd1e8650-4c00-4565-bd2b-8877527b42eb req-66586fbe-2927-4eba-a605-cc0f4d3caa3c tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc031608-d602-4ec5-94fb-8768eafaf0c2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:18 devstack sudo[95624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc031608-d602-4ec5-94fb-8768eafaf0c2
Jul 03 23:59:18 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:18 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.757s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:18 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:59:18 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Deleted volume successfully.
Jul 03 23:59:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d94e4844-34dc-4bf3-9b79-2e21b5c653d7 tempest-VolumesGetTest-572136402 None] Lock "cinder-bca9d673-7b3b-40c9-9ac8-f367a4626eb5-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:19 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-bd1e8650-4c00-4565-bd2b-8877527b42eb req-66586fbe-2927-4eba-a605-cc0f4d3caa3c tempest-AttachVolumeNegativeTest-608528329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc031608-d602-4ec5-94fb-8768eafaf0c2" returned: 0 in 0.981s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-bd1e8650-4c00-4565-bd2b-8877527b42eb req-66586fbe-2927-4eba-a605-cc0f4d3caa3c tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Acquiring lock "cinder-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Lock "cinder-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-bd1e8650-4c00-4565-bd2b-8877527b42eb req-66586fbe-2927-4eba-a605-cc0f4d3caa3c tempest-AttachVolumeNegativeTest-608528329 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-bc031608-d602-4ec5-94fb-8768eafaf0c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4bc18638-4312-4d2f-a244-53c7db948328', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:59:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Acquiring lock "cinder-quobyte-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce" acquired by "delete_volume" :: waited 0.032s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:19 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e668c95a-432c-405e-b074-91cc6a8a0d8f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:19 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-bd1e8650-4c00-4565-bd2b-8877527b42eb req-66586fbe-2927-4eba-a605-cc0f4d3caa3c tempest-AttachVolumeNegativeTest-608528329 None] attachment_update completed successfully.
Jul 03 23:59:19 devstack sudo[95630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce
Jul 03 23:59:19 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:20 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce" returned: 0 in 1.039s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:20 devstack sudo[95702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce
Jul 03 23:59:20 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:21 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce" returned: 0 in 0.875s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce" released by "delete_volume" :: held 2.018s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:21 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Created reservations ['18f87080-efe3-48a6-a226-3586d886bfb4', '3a423d1f-2664-4de3-9b8b-ee5fdd1c27ed', '615e6845-dda5-44e0-bbb3-0693603b78cf', '6d898760-814c-4bd2-befc-1f53b8e8efb8'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:59:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:21 devstack sudo[96023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:59:21 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:22 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.994s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:22 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:59:22 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Deleted volume successfully.
Jul 03 23:59:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-efa47039-cb0c-4822-92b3-a8dae6faab66 tempest-VolumesGetTest-572136402 None] Lock "cinder-7b6031ee-0bce-4fe8-b8ee-f3b3432b8bce-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:22 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:59:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Flow 'volume_create_manager' (890ebb83-e370-4123-a2e2-dd8a4c3d0fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b07bf9-3266-49f0-bc1c-408766731042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b07bf9-3266-49f0-bc1c-408766731042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-688347508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad813477-2715-449b-bef5-1b9a04d7f51f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13cb11ee047f4009a814166bbbbb44fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:23Z,use_quota=True,user_id='bb4b7a6931f44c3690dd5d168a73823a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a3f645-cf85-4878-8290-097e3711a9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a3f645-cf85-4878-8290-097e3711a9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bee5d35-2b29-4d0a-829d-59280458da88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:22 devstack cinder-volume[86650]: DEBUG cinder.image.glance [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Creating Keystone auth plugin from conf {{(pid=86650) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 03 23:59:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bee5d35-2b29-4d0a-829d-59280458da88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ad813477-2715-449b-bef5-1b9a04d7f51f', 'volume_name': 'volume-ad813477-2715-449b-bef5-1b9a04d7f51f', 'volume_size': 1, 'image_id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee7f20f7f01043bc91ea80a8d5f6c3f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'created_at': datetime.datetime(2026, 7, 3, 21, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 43, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000b76480>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439f8fa3-0301-4601-bac2-44cb8a8c69ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (439f8fa3-0301-4601-bac2-44cb8a8c69ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae2f338-d2b7-46db-a31c-8a610b937427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:23 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Volume ad813477-2715-449b-bef5-1b9a04d7f51f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ad813477-2715-449b-bef5-1b9a04d7f51f', 'volume_size': 1, 'image_id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee7f20f7f01043bc91ea80a8d5f6c3f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'created_at': datetime.datetime(2026, 7, 3, 21, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 43, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000b76480>}
Jul 03 23:59:23 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Trying to clone ad813477-2715-449b-bef5-1b9a04d7f51f from image b8f0cc76-877f-40ea-bce4-db07a2ff6489 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}]). {{(pid=86650) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 03 23:59:23 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_iqitohtwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 03 23:59:23 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Image download 20.69 MB at 20.69 MB/s
Jul 03 23:59:23 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ebdcc3-c625-4e7d-a9aa-4fe105725b58]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_iqitohtwdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:23 devstack sudo[96028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_iqitohtwdevstack@QuobyteHD
Jul 03 23:59:23 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:24 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_iqitohtwdevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:24 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Temporary image b8f0cc76-877f-40ea-bce4-db07a2ff6489 is fetched for user bb4b7a6931f44c3690dd5d168a73823a. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 03 23:59:24 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e97147b-34d0-4628-b29b-b57a9a37a5ec]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_iqitohtwdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:24 devstack sudo[96033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_iqitohtwdevstack@QuobyteHD
Jul 03 23:59:24 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:25 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_iqitohtwdevstack@QuobyteHD" returned: 0 in 0.806s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-688347508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad813477-2715-449b-bef5-1b9a04d7f51f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='13cb11ee047f4009a814166bbbbb44fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:23Z,use_quota=True,user_id='bb4b7a6931f44c3690dd5d168a73823a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:59:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Creating volume ad813477-2715-449b-bef5-1b9a04d7f51f {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:59:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:59:25 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:59:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:25 devstack sudo[96038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f 1073741824
Jul 03 23:59:25 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:26 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-c56c1b42-f146-4e22-94ac-32adc6d7307f req-baea3230-718d-4062-b1e5-34d93d81fbd2 tempest-AttachVolumeNegativeTest-608528329 None] Terminate volume connection completed successfully.
Jul 03 23:59:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-c56c1b42-f146-4e22-94ac-32adc6d7307f req-baea3230-718d-4062-b1e5-34d93d81fbd2 tempest-AttachVolumeNegativeTest-608528329 None] Deleting attachment 4bc18638-4312-4d2f-a244-53c7db948328. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 03 23:59:26 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f 1073741824" returned: 0 in 1.230s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:26 devstack sudo[96071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f
Jul 03 23:59:26 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:27 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f" returned: 0 in 1.256s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] <== create_volume: return (2546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:59:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.552s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:27 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Attempting download of b8f0cc76-877f-40ea-bce4-db07a2ff6489 ((None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}])) to volume ad813477-2715-449b-bef5-1b9a04d7f51f. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 03 23:59:27 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fb2563-e822-4195-b9c6-721f72f2a291]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_vi2f182c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-23f28c17-46be-47b3-810c-f708cea46d25 req-fef50739-833b-4aee-bfa7-e2489c35bfc8 tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-23f28c17-46be-47b3-810c-f708cea46d25 req-fef50739-833b-4aee-bfa7-e2489c35bfc8 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:28 devstack sudo[96082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_vi2f182c
Jul 03 23:59:28 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:28 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecc2183-ac75-44fb-a997-95bc88d8b75e]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-23f28c17-46be-47b3-810c-f708cea46d25 req-fef50739-833b-4aee-bfa7-e2489c35bfc8 tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:28 devstack sudo[96084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb
Jul 03 23:59:28 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:29 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_vi2f182c" returned: 0 in 1.172s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_vi2f182c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:29 devstack sudo[96088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_vi2f182c
Jul 03 23:59:29 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:29 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-23f28c17-46be-47b3-810c-f708cea46d25 req-fef50739-833b-4aee-bfa7-e2489c35bfc8 tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb" returned: 0 in 1.389s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-23f28c17-46be-47b3-810c-f708cea46d25 req-fef50739-833b-4aee-bfa7-e2489c35bfc8 tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:29 devstack sudo[96093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb
Jul 03 23:59:29 devstack sudo[96093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:30 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_vi2f182c" returned: 1 in 1.075s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_vi2f182c' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:59:30 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ff52b5-63c6-4f02-8e9f-1634a329c75f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_iqitohtwdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:30 devstack sudo[96103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_iqitohtwdevstack@QuobyteHD
Jul 03 23:59:30 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:30 devstack sudo[96093]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-23f28c17-46be-47b3-810c-f708cea46d25 req-fef50739-833b-4aee-bfa7-e2489c35bfc8 tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb" returned: 1 in 1.130s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-23f28c17-46be-47b3-810c-f708cea46d25 req-fef50739-833b-4aee-bfa7-e2489c35bfc8 tempest-TestInstancesWithCinderVolumes-556844828 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:59:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-23f28c17-46be-47b3-810c-f708cea46d25 req-fef50739-833b-4aee-bfa7-e2489c35bfc8 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.587s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-23f28c17-46be-47b3-810c-f708cea46d25 req-fef50739-833b-4aee-bfa7-e2489c35bfc8 tempest-TestInstancesWithCinderVolumes-556844828 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c3a0146-425b-41aa-8075-b234535c80e5', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 03 23:59:31 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-23f28c17-46be-47b3-810c-f708cea46d25 req-fef50739-833b-4aee-bfa7-e2489c35bfc8 tempest-TestInstancesWithCinderVolumes-556844828 None] attachment_update completed successfully.
Jul 03 23:59:31 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_iqitohtwdevstack@QuobyteHD" returned: 0 in 1.249s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:31 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] b8f0cc76-877f-40ea-bce4-db07a2ff6489 was qcow2, converting to raw {{(pid=86650) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 03 23:59:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_iqitohtwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:31 devstack sudo[96129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_iqitohtwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f
Jul 03 23:59:31 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:34 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_iqitohtwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f" returned: 0 in 2.762s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:34 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_iqitohtwdevstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 03 23:59:34 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Converted 112.00 MB image at 40.53 MB/s
Jul 03 23:59:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:34 devstack sudo[96207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f 1G
Jul 03 23:59:34 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:35 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f 1G" returned: 0 in 0.971s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:35 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e83363-fb7b-432f-84dc-640b9cb542a7]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:35 devstack sudo[96246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f
Jul 03 23:59:35 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:36 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f" returned: 0 in 1.153s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:36 devstack sudo[96268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f
Jul 03 23:59:36 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:37 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f" returned: 1 in 1.266s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:59:37 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Downloaded image b8f0cc76-877f-40ea-bce4-db07a2ff6489 ((None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}])) to volume ad813477-2715-449b-bef5-1b9a04d7f51f successfully. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 03 23:59:37 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Temporary image b8f0cc76-877f-40ea-bce4-db07a2ff6489 for user bb4b7a6931f44c3690dd5d168a73823a is deleted. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 03 23:59:37 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Marking volume ad813477-2715-449b-bef5-1b9a04d7f51f as bootable. {{(pid=86650) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 03 23:59:37 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Copying metadata from image b8f0cc76-877f-40ea-bce4-db07a2ff6489 to ad813477-2715-449b-bef5-1b9a04d7f51f. {{(pid=86650) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 03 23:59:37 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Creating volume glance metadata for volume ad813477-2715-449b-bef5-1b9a04d7f51f backed by image b8f0cc76-877f-40ea-bce4-db07a2ff6489 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86650) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 03 23:59:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fae2f338-d2b7-46db-a31c-8a610b937427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad813477-2715-449b-bef5-1b9a04d7f51f', 'volume_size': 1, 'image_id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee7f20f7f01043bc91ea80a8d5f6c3f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'created_at': datetime.datetime(2026, 7, 3, 21, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 43, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000b76480>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d235128e-fa4e-48e4-a2b0-e77ea60b7fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:37 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Volume volume-ad813477-2715-449b-bef5-1b9a04d7f51f (ad813477-2715-449b-bef5-1b9a04d7f51f): created successfully
Jul 03 23:59:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d235128e-fa4e-48e4-a2b0-e77ea60b7fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Flow 'volume_create_manager' (890ebb83-e370-4123-a2e2-dd8a4c3d0fde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:38 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-2fda738e-8791-46a6-a7e1-7858a566fa84 tempest-VolumesGetTest-572136402 None] Created volume successfully.
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Flow 'volume_create_manager' (59f41f53-9d3e-4f12-b24a-9a424b2164e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78574d1f-114b-4fe1-a4b6-edde28f6d3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78574d1f-114b-4fe1-a4b6-edde28f6d3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-402572728',display_name='tempest-VolumesGetTest-Volume-1517825624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cb11ee047f4009a814166bbbbb44fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:40Z,use_quota=True,user_id='bb4b7a6931f44c3690dd5d168a73823a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39159f5-1a2a-44eb-99ff-d78061808c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39159f5-1a2a-44eb-99ff-d78061808c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b3d6cc-cea1-47d2-a275-684d3130e243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b3d6cc-cea1-47d2-a275-684d3130e243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf', 'volume_name': 'volume-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10cedb53-5529-40d6-8970-8cd95cb6b215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10cedb53-5529-40d6-8970-8cd95cb6b215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b929fa5c-2956-4dd8-b531-c54cc3531340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:40 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Volume cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf', 'volume_size': 1}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-402572728',display_name='tempest-VolumesGetTest-Volume-1517825624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13cb11ee047f4009a814166bbbbb44fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:40Z,use_quota=True,user_id='bb4b7a6931f44c3690dd5d168a73823a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Creating volume cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:59:40 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:59:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:40 devstack sudo[96602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf 1073741824
Jul 03 23:59:40 devstack sudo[96602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:42 devstack sudo[96602]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf 1073741824" returned: 0 in 1.976s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:42 devstack sudo[96608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf
Jul 03 23:59:42 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:43 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf" returned: 0 in 1.308s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] <== create_volume: return (3360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:59:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.364s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Flow 'volume_create_manager' (10dcbd20-f4cd-45b4-a809-dc10581e95c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a360f9b2-6d56-471f-b270-ee011a20d37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b929fa5c-2956-4dd8-b531-c54cc3531340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3931e27-0ac2-4e2d-be1a-a6839c5e1d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a360f9b2-6d56-471f-b270-ee011a20d37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-546157525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25866842-0d27-44e9-84b4-e355340497bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0c4535d39b401396c7e99ca2ccde16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:44Z,use_quota=True,user_id='16744bec6a0d4381a010e9b358911987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957548ab-6966-4267-89a7-cbb3fc3f24f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (957548ab-6966-4267-89a7-cbb3fc3f24f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fe52bf-144b-49bb-ab65-9cdb92abac31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62fe52bf-144b-49bb-ab65-9cdb92abac31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25866842-0d27-44e9-84b4-e355340497bf', 'volume_name': 'volume-25866842-0d27-44e9-84b4-e355340497bf', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46296113-dbfb-4244-a2d6-408e98ad1b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46296113-dbfb-4244-a2d6-408e98ad1b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e97dd8-f171-455f-ae41-a2545296a3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:44 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Volume 25866842-0d27-44e9-84b4-e355340497bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25866842-0d27-44e9-84b4-e355340497bf', 'volume_size': 1}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-546157525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25866842-0d27-44e9-84b4-e355340497bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0c4535d39b401396c7e99ca2ccde16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:44Z,use_quota=True,user_id='16744bec6a0d4381a010e9b358911987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Creating volume 25866842-0d27-44e9-84b4-e355340497bf {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:59:44 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-25866842-0d27-44e9-84b4-e355340497bf 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:44 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Volume volume-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf (cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf): created successfully
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3931e27-0ac2-4e2d-be1a-a6839c5e1d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Flow 'volume_create_manager' (59f41f53-9d3e-4f12-b24a-9a424b2164e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:44 devstack sudo[96615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-25866842-0d27-44e9-84b4-e355340497bf 1073741824
Jul 03 23:59:44 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-1ebea3a3-eb53-4570-9d90-6bfbeb2bca86 tempest-VolumesGetTest-572136402 None] Created volume successfully.
Jul 03 23:59:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Acquiring lock "cinder-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Lock "cinder-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Acquiring lock "cinder-quobyte-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf" acquired by "delete_volume" :: waited 0.031s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:45 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a98058-1f87-4074-816e-eeca535b0f14]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:45 devstack sudo[96623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf
Jul 03 23:59:45 devstack sudo[96623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:45 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-25866842-0d27-44e9-84b4-e355340497bf 1073741824" returned: 0 in 1.625s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-25866842-0d27-44e9-84b4-e355340497bf {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:45 devstack sudo[96659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-25866842-0d27-44e9-84b4-e355340497bf
Jul 03 23:59:45 devstack sudo[96659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:46 devstack sudo[96623]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf" returned: 0 in 1.530s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:47 devstack sudo[96666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf
Jul 03 23:59:47 devstack sudo[96666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:47 devstack sudo[96659]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-25866842-0d27-44e9-84b4-e355340497bf" returned: 0 in 1.901s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] <== create_volume: return (3650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:59:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.652s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e97dd8-f171-455f-ae41-a2545296a3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25866842-0d27-44e9-84b4-e355340497bf', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94ecb9d-386b-4603-b91d-04257c070598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:47 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Volume volume-25866842-0d27-44e9-84b4-e355340497bf (25866842-0d27-44e9-84b4-e355340497bf): created successfully
Jul 03 23:59:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f94ecb9d-386b-4603-b91d-04257c070598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Flow 'volume_create_manager' (10dcbd20-f4cd-45b4-a809-dc10581e95c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:47 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-0ea4cd02-48a5-46b2-a2ff-5da8956b1fda tempest-VolumesListAdminTestJSON-1544841865 None] Created volume successfully.
Jul 03 23:59:48 devstack sudo[96666]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf" returned: 0 in 1.430s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf" released by "delete_volume" :: held 3.043s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:48 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Created reservations ['1a82a5e1-5da6-4fa4-bd2f-4af05865a812', '02e90af5-9afd-408a-82cf-677466bba0f8', '3a687f70-a4f5-4dc7-993f-fb5ae4721ead', '0288d653-8a45-49bd-b2ee-3ae8dc4c09e6'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:59:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:48 devstack sudo[96670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:59:48 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Acquiring lock "cinder-ad813477-2715-449b-bef5-1b9a04d7f51f-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Lock "cinder-ad813477-2715-449b-bef5-1b9a04d7f51f-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Acquiring lock "cinder-quobyte-ad813477-2715-449b-bef5-1b9a04d7f51f" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 03 23:59:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-ad813477-2715-449b-bef5-1b9a04d7f51f" acquired by "delete_volume" :: waited 0.049s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 03 23:59:49 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee76f28-ab0c-4753-870a-e46f6e29358c]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 03 23:59:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:49 devstack sudo[96672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f
Jul 03 23:59:49 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:50 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.535s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Flow 'volume_create_manager' (f53f11a6-637a-4d51-b788-b2f33003af33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff4dc8a2-b143-41bb-96b5-79fb798463ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:50 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Deleted volume successfully.
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff4dc8a2-b143-41bb-96b5-79fb798463ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1024433082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51820102-07dd-404a-9089-34116ec0be3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0c4535d39b401396c7e99ca2ccde16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:50Z,use_quota=True,user_id='16744bec6a0d4381a010e9b358911987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91b5dec-502f-4b1a-ab63-72b52768cba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91b5dec-502f-4b1a-ab63-72b52768cba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b917bc62-b7a7-43b0-85f1-d9b08a0648ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b917bc62-b7a7-43b0-85f1-d9b08a0648ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51820102-07dd-404a-9089-34116ec0be3f', 'volume_name': 'volume-51820102-07dd-404a-9089-34116ec0be3f', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e37d54-58b5-4bad-888a-cc3bb30e2355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e37d54-58b5-4bad-888a-cc3bb30e2355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3ba677-ab89-4d04-9f58-b2c2f392b579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:50 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Volume 51820102-07dd-404a-9089-34116ec0be3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51820102-07dd-404a-9089-34116ec0be3f', 'volume_size': 1}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1024433082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51820102-07dd-404a-9089-34116ec0be3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0c4535d39b401396c7e99ca2ccde16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:50Z,use_quota=True,user_id='16744bec6a0d4381a010e9b358911987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Creating volume 51820102-07dd-404a-9089-34116ec0be3f {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:59:50 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51820102-07dd-404a-9089-34116ec0be3f 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1e040a8b-f091-4211-b076-de4b0b8af17c tempest-VolumesGetTest-572136402 None] Lock "cinder-cdcb4013-cd9c-4bfe-8c94-7660fcfc6ddf-delete_volume" released by "delete_volume" :: held 5.309s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:50 devstack sudo[96675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51820102-07dd-404a-9089-34116ec0be3f 1073741824
Jul 03 23:59:50 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:50 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f" returned: 0 in 1.535s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:51 devstack sudo[96679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f
Jul 03 23:59:51 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:52 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f" returned: 1 in 1.718s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 03 23:59:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:52 devstack sudo[96703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f
Jul 03 23:59:52 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:53 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51820102-07dd-404a-9089-34116ec0be3f 1073741824" returned: 0 in 2.689s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51820102-07dd-404a-9089-34116ec0be3f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:53 devstack sudo[96709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51820102-07dd-404a-9089-34116ec0be3f
Jul 03 23:59:53 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:53 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ad813477-2715-449b-bef5-1b9a04d7f51f" returned: 0 in 1.260s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Lock "cinder-quobyte-ad813477-2715-449b-bef5-1b9a04d7f51f" released by "delete_volume" :: held 4.660s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:54 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Created reservations ['a31be8dc-7f27-4a48-8330-18a2aee0be8c', '8d1cd9f0-f85a-4a32-93ec-c69bdf5658a8', '7c8845f5-e391-4ee7-a258-a615e8f8114e', '4149cd75-f072-4fdb-b193-42520a982f0d'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 03 23:59:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:54 devstack sudo[96737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 03 23:59:54 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:54 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51820102-07dd-404a-9089-34116ec0be3f" returned: 0 in 1.560s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] <== create_volume: return (4348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:59:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.353s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3ba677-ab89-4d04-9f58-b2c2f392b579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51820102-07dd-404a-9089-34116ec0be3f', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc7c4c1-aaae-46f2-b957-040bc1095493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:54 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Volume volume-51820102-07dd-404a-9089-34116ec0be3f (51820102-07dd-404a-9089-34116ec0be3f): created successfully
Jul 03 23:59:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dc7c4c1-aaae-46f2-b957-040bc1095493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Flow 'volume_create_manager' (f53f11a6-637a-4d51-b788-b2f33003af33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:54 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-09aaceaa-4415-42c9-bbb4-163344d4bbd2 tempest-VolumesListAdminTestJSON-1544841865 None] Created volume successfully.
Jul 03 23:59:54 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=77,cinder:UPDATE=79,cinder:INSERT=26,cinder:DELETE=7 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:59:55 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.996s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:55 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 03 23:59:55 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Deleted volume successfully.
Jul 03 23:59:55 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=72,cinder:UPDATE=94,cinder:INSERT=31,cinder:DELETE=10 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 03 23:59:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a75af634-93f2-4f85-ae2c-2410a9ae87eb tempest-VolumesGetTest-572136402 None] Lock "cinder-ad813477-2715-449b-bef5-1b9a04d7f51f-delete_volume" released by "delete_volume" :: held 6.269s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Flow 'volume_create_manager' (93042d5c-7b27-4153-9086-6364c875554e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba55ffb-4a1b-4e44-83e8-ae3a281aca26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fba55ffb-4a1b-4e44-83e8-ae3a281aca26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1690836643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2127b544-2736-4ca0-9c9c-b0f3975c82ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0c4535d39b401396c7e99ca2ccde16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:56Z,use_quota=True,user_id='16744bec6a0d4381a010e9b358911987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ef0bea-f55f-463d-9497-dbf4a3897460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ef0bea-f55f-463d-9497-dbf4a3897460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d27a369-8a53-40fe-b344-4c10a71e58e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d27a369-8a53-40fe-b344-4c10a71e58e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2127b544-2736-4ca0-9c9c-b0f3975c82ae', 'volume_name': 'volume-2127b544-2736-4ca0-9c9c-b0f3975c82ae', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858bd81b-987b-40e2-82de-449dc4aacda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858bd81b-987b-40e2-82de-449dc4aacda6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25aff7c-cc1f-4c28-921a-da62b88aac30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:56 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Volume 2127b544-2736-4ca0-9c9c-b0f3975c82ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2127b544-2736-4ca0-9c9c-b0f3975c82ae', 'volume_size': 1}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T21:59:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1690836643',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2127b544-2736-4ca0-9c9c-b0f3975c82ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd0c4535d39b401396c7e99ca2ccde16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T21:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T21:59:56Z,use_quota=True,user_id='16744bec6a0d4381a010e9b358911987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Creating volume 2127b544-2736-4ca0-9c9c-b0f3975c82ae {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 03 23:59:56 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 03 23:59:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2127b544-2736-4ca0-9c9c-b0f3975c82ae 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:56 devstack sudo[96814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2127b544-2736-4ca0-9c9c-b0f3975c82ae 1073741824
Jul 03 23:59:56 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:57 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2127b544-2736-4ca0-9c9c-b0f3975c82ae 1073741824" returned: 0 in 1.083s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2127b544-2736-4ca0-9c9c-b0f3975c82ae {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 03 23:59:57 devstack sudo[96820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2127b544-2736-4ca0-9c9c-b0f3975c82ae
Jul 03 23:59:57 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 03 23:59:58 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root
Jul 03 23:59:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2127b544-2736-4ca0-9c9c-b0f3975c82ae" returned: 0 in 1.080s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 03 23:59:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] <== create_volume: return (2225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 03 23:59:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.230s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 03 23:59:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25aff7c-cc1f-4c28-921a-da62b88aac30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2127b544-2736-4ca0-9c9c-b0f3975c82ae', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf94360-4835-4ced-a076-8377b7076a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 03 23:59:58 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Volume volume-2127b544-2736-4ca0-9c9c-b0f3975c82ae (2127b544-2736-4ca0-9c9c-b0f3975c82ae): created successfully
Jul 03 23:59:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cf94360-4835-4ced-a076-8377b7076a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 03 23:59:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Flow 'volume_create_manager' (93042d5c-7b27-4153-9086-6364c875554e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 03 23:59:58 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f9fd135e-c822-4fbb-9dc2-ffbc750d503d tempest-VolumesListAdminTestJSON-1544841865 None] Created volume successfully.
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Flow 'volume_create_manager' (2ad537a8-7696-466f-b4b6-aefe9b2bd85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17162ce1-4aac-4277-a6d2-f7443ecc0ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17162ce1-4aac-4277-a6d2-f7443ecc0ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-296891151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2270ee4e-158a-421a-a509-b1778bd705f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866e6b1912a54d2c869c11a374fafa84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:00Z,use_quota=True,user_id='435ec68b1eb649d0b07acc4652f57855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e049593-bbcb-41f8-a1c3-1a61d47ee4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e049593-bbcb-41f8-a1c3-1a61d47ee4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e0a658-ab4c-4867-820d-6958533958ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e0a658-ab4c-4867-820d-6958533958ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2270ee4e-158a-421a-a509-b1778bd705f0', 'volume_name': 'volume-2270ee4e-158a-421a-a509-b1778bd705f0', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e023535-60a9-49c7-8511-84117aee1b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e023535-60a9-49c7-8511-84117aee1b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3d0fe4-ccb0-4100-99a9-bbf222a635ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:00 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Volume 2270ee4e-158a-421a-a509-b1778bd705f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2270ee4e-158a-421a-a509-b1778bd705f0', 'volume_size': 1}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-296891151',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2270ee4e-158a-421a-a509-b1778bd705f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866e6b1912a54d2c869c11a374fafa84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:00Z,use_quota=True,user_id='435ec68b1eb649d0b07acc4652f57855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Creating volume 2270ee4e-158a-421a-a509-b1778bd705f0 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:00 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2270ee4e-158a-421a-a509-b1778bd705f0 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:00 devstack sudo[96889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2270ee4e-158a-421a-a509-b1778bd705f0 1073741824
Jul 04 00:00:00 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Flow 'volume_create_manager' (366a2158-a1ee-4c25-9253-0be69a8f3242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81bd309-b344-4298-8379-d0558b8a42c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81bd309-b344-4298-8379-d0558b8a42c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaaab22e-a470-4bd0-a872-01689b016467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7569b1ff6cf246f4801b2958eb240793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:00Z,use_quota=True,user_id='6518f819b7574e20b147867050bbee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea33174-114a-410b-bd5b-33526092926e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea33174-114a-410b-bd5b-33526092926e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ea651e-0e21-4155-8b78-2bd0953c1b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69ea651e-0e21-4155-8b78-2bd0953c1b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaaab22e-a470-4bd0-a872-01689b016467', 'volume_name': 'volume-aaaab22e-a470-4bd0-a872-01689b016467', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0a3c7c-5482-4898-b82e-2a717902c712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0a3c7c-5482-4898-b82e-2a717902c712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd98e2a-d17b-46ca-9afc-3bc7200af9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:00 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Volume aaaab22e-a470-4bd0-a872-01689b016467: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaaab22e-a470-4bd0-a872-01689b016467', 'volume_size': 1}
Jul 04 00:00:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:01 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2270ee4e-158a-421a-a509-b1778bd705f0 1073741824" returned: 0 in 1.042s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2270ee4e-158a-421a-a509-b1778bd705f0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:01 devstack sudo[96897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2270ee4e-158a-421a-a509-b1778bd705f0
Jul 04 00:00:01 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:01 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2270ee4e-158a-421a-a509-b1778bd705f0" returned: 0 in 0.800s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] <== create_volume: return (1889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.408s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaaab22e-a470-4bd0-a872-01689b016467,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7569b1ff6cf246f4801b2958eb240793',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:00Z,use_quota=True,user_id='6518f819b7574e20b147867050bbee83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Creating volume aaaab22e-a470-4bd0-a872-01689b016467 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:02 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aaaab22e-a470-4bd0-a872-01689b016467 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:02 devstack sudo[96900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aaaab22e-a470-4bd0-a872-01689b016467 1073741824
Jul 04 00:00:02 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd3d0fe4-ccb0-4100-99a9-bbf222a635ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2270ee4e-158a-421a-a509-b1778bd705f0', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df4c471-53c0-42e8-949b-437f43fa9f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:02 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Volume volume-2270ee4e-158a-421a-a509-b1778bd705f0 (2270ee4e-158a-421a-a509-b1778bd705f0): created successfully
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df4c471-53c0-42e8-949b-437f43fa9f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Flow 'volume_create_manager' (2ad537a8-7696-466f-b4b6-aefe9b2bd85d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:02 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-fc5c8e49-740f-4e3e-a344-f681a4109fac tempest-ProjectReaderTests-427535164 None] Created volume successfully.
Jul 04 00:00:03 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aaaab22e-a470-4bd0-a872-01689b016467 1073741824" returned: 0 in 1.083s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aaaab22e-a470-4bd0-a872-01689b016467 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:03 devstack sudo[96906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aaaab22e-a470-4bd0-a872-01689b016467
Jul 04 00:00:03 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Acquiring lock "cinder-2270ee4e-158a-421a-a509-b1778bd705f0-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Lock "cinder-2270ee4e-158a-421a-a509-b1778bd705f0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Acquiring lock "cinder-quobyte-2270ee4e-158a-421a-a509-b1778bd705f0" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Lock "cinder-quobyte-2270ee4e-158a-421a-a509-b1778bd705f0" acquired by "delete_volume" :: waited 0.033s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:04 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6653fad-a2b5-4168-9576-14adbcea280f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2270ee4e-158a-421a-a509-b1778bd705f0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:04 devstack sudo[96910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2270ee4e-158a-421a-a509-b1778bd705f0
Jul 04 00:00:04 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:04 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aaaab22e-a470-4bd0-a872-01689b016467" returned: 0 in 1.360s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] <== create_volume: return (2544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.550s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd98e2a-d17b-46ca-9afc-3bc7200af9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaaab22e-a470-4bd0-a872-01689b016467', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda40848-f15e-4896-af0b-38fac57b9cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:04 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Volume volume-aaaab22e-a470-4bd0-a872-01689b016467 (aaaab22e-a470-4bd0-a872-01689b016467): created successfully
Jul 04 00:00:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda40848-f15e-4896-af0b-38fac57b9cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Flow 'volume_create_manager' (366a2158-a1ee-4c25-9253-0be69a8f3242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:04 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c3a1f1ea-cb8c-4c55-a1c2-ece2171578e2 tempest-VolumesListAdminTestJSON-1675875119 None] Created volume successfully.
Jul 04 00:00:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Acquiring lock "cinder-aaaab22e-a470-4bd0-a872-01689b016467-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Lock "cinder-aaaab22e-a470-4bd0-a872-01689b016467-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Acquiring lock "cinder-quobyte-aaaab22e-a470-4bd0-a872-01689b016467" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:05 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2270ee4e-158a-421a-a509-b1778bd705f0" returned: 0 in 1.248s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2270ee4e-158a-421a-a509-b1778bd705f0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Lock "cinder-quobyte-aaaab22e-a470-4bd0-a872-01689b016467" acquired by "delete_volume" :: waited 0.054s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:05 devstack sudo[96918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2270ee4e-158a-421a-a509-b1778bd705f0
Jul 04 00:00:05 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00f9d00-ce3b-413a-b4d0-d4fba0a09a84]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:05 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aaaab22e-a470-4bd0-a872-01689b016467 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Acquiring lock "cinder-2127b544-2736-4ca0-9c9c-b0f3975c82ae-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Lock "cinder-2127b544-2736-4ca0-9c9c-b0f3975c82ae-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:05 devstack sudo[96920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aaaab22e-a470-4bd0-a872-01689b016467
Jul 04 00:00:05 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Acquiring lock "cinder-quobyte-2127b544-2736-4ca0-9c9c-b0f3975c82ae" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Lock "cinder-quobyte-2127b544-2736-4ca0-9c9c-b0f3975c82ae" acquired by "delete_volume" :: waited 0.033s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:05 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa5142d-8e65-4fdf-bbff-30768a501a91]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2127b544-2736-4ca0-9c9c-b0f3975c82ae {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:06 devstack sudo[96922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2127b544-2736-4ca0-9c9c-b0f3975c82ae
Jul 04 00:00:06 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:06 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2270ee4e-158a-421a-a509-b1778bd705f0" returned: 0 in 1.420s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Lock "cinder-quobyte-2270ee4e-158a-421a-a509-b1778bd705f0" released by "delete_volume" :: held 2.837s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:06 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Created reservations ['520c02a8-1829-4418-89c9-bacd0bf2bb11', 'ea823d71-1a62-4cd3-bfbb-467587734961', '669ebe11-52ca-4adc-87f4-1876c3da82be', 'bbeb847a-9edb-4fa2-863f-6498eae56e46'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:06 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aaaab22e-a470-4bd0-a872-01689b016467" returned: 0 in 1.567s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aaaab22e-a470-4bd0-a872-01689b016467 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:07 devstack sudo[96932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aaaab22e-a470-4bd0-a872-01689b016467
Jul 04 00:00:07 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:07 devstack sudo[96933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:00:07 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:07 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2127b544-2736-4ca0-9c9c-b0f3975c82ae" returned: 0 in 1.655s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2127b544-2736-4ca0-9c9c-b0f3975c82ae {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:07 devstack sudo[96942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2127b544-2736-4ca0-9c9c-b0f3975c82ae
Jul 04 00:00:07 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:08 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-aaaab22e-a470-4bd0-a872-01689b016467" returned: 0 in 1.347s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Lock "cinder-quobyte-aaaab22e-a470-4bd0-a872-01689b016467" released by "delete_volume" :: held 3.080s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:08 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.453s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:08 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:08 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Deleted volume successfully.
Jul 04 00:00:08 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Created reservations ['f999c04f-fb88-4456-b831-eb3cb59f79eb', '032703ca-5b2f-45e5-b365-24f780ac04c3', 'b9a38116-eda1-4d55-990e-937474e3a80a', 'e185edc9-d6c2-4bab-9fab-966f405475e4'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-588b404f-19cd-48e4-abc6-95d6f7b8f2c7 tempest-ProjectReaderTests-427535164 None] Lock "cinder-2270ee4e-158a-421a-a509-b1778bd705f0-delete_volume" released by "delete_volume" :: held 4.814s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:08 devstack sudo[96978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:00:08 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:09 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Flow 'volume_create_manager' (b9b88ae1-e486-45f2-9f2c-65f43dc6e292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ce7548-d8d9-45c7-bd51-4c19481fc256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2127b544-2736-4ca0-9c9c-b0f3975c82ae" returned: 0 in 1.605s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ce7548-d8d9-45c7-bd51-4c19481fc256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899436658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e0019b-53c8-4253-81e1-22c305cbb62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866e6b1912a54d2c869c11a374fafa84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:09Z,use_quota=True,user_id='435ec68b1eb649d0b07acc4652f57855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febd1f3f-88ed-41b4-a929-db58c1ae4b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febd1f3f-88ed-41b4-a929-db58c1ae4b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46458941-9e4f-494e-86f2-3080c364c5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46458941-9e4f-494e-86f2-3080c364c5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37e0019b-53c8-4253-81e1-22c305cbb62e', 'volume_name': 'volume-37e0019b-53c8-4253-81e1-22c305cbb62e', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11840f5a-8501-4592-95a6-67a1252757c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11840f5a-8501-4592-95a6-67a1252757c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a293af2-957d-4185-bec8-d030cc11f681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:09 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Volume 37e0019b-53c8-4253-81e1-22c305cbb62e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37e0019b-53c8-4253-81e1-22c305cbb62e', 'volume_size': 1}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899436658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e0019b-53c8-4253-81e1-22c305cbb62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='866e6b1912a54d2c869c11a374fafa84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:09Z,use_quota=True,user_id='435ec68b1eb649d0b07acc4652f57855',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Creating volume 37e0019b-53c8-4253-81e1-22c305cbb62e {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:09 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-37e0019b-53c8-4253-81e1-22c305cbb62e 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Lock "cinder-quobyte-2127b544-2736-4ca0-9c9c-b0f3975c82ae" released by "delete_volume" :: held 3.415s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:09 devstack sudo[97021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-37e0019b-53c8-4253-81e1-22c305cbb62e 1073741824
Jul 04 00:00:09 devstack sudo[97021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Created reservations ['b02e2b64-e3e8-4439-9d53-389da66fc583', 'f1a9ec94-442c-4b62-b21b-09edb0dcf03e', '36567a4f-abce-4ac7-a58f-ff3d09b0529e', '4af3436d-5b1d-4115-ab9c-487e8eb5d33c'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:09 devstack sudo[97023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:00:09 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:09 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.882s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:09 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Deleted volume successfully.
Jul 04 00:00:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-511f7d3a-9766-44d0-9cbd-64319b294786 tempest-VolumesListAdminTestJSON-1675875119 None] Lock "cinder-aaaab22e-a470-4bd0-a872-01689b016467-delete_volume" released by "delete_volume" :: held 4.623s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:10 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.936s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:10 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:10 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Deleted volume successfully.
Jul 04 00:00:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-025ab3ba-55ee-4169-b2fb-eb3d6f9b75eb tempest-VolumesListAdminTestJSON-1544841865 None] Lock "cinder-2127b544-2736-4ca0-9c9c-b0f3975c82ae-delete_volume" released by "delete_volume" :: held 4.739s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Acquiring lock "cinder-51820102-07dd-404a-9089-34116ec0be3f-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Lock "cinder-51820102-07dd-404a-9089-34116ec0be3f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Acquiring lock "cinder-quobyte-51820102-07dd-404a-9089-34116ec0be3f" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Lock "cinder-quobyte-51820102-07dd-404a-9089-34116ec0be3f" acquired by "delete_volume" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:10 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a04dfd7-0b71-4417-8d43-3b4486e8f4cc]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51820102-07dd-404a-9089-34116ec0be3f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:10 devstack sudo[97037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51820102-07dd-404a-9089-34116ec0be3f
Jul 04 00:00:10 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:10 devstack sudo[97021]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-37e0019b-53c8-4253-81e1-22c305cbb62e 1073741824" returned: 0 in 1.601s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-0135eb49-fd51-4024-b269-7baaaa8a86a3 req-c9f53bb8-12d1-4d9b-8321-1f598d692522 tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-37e0019b-53c8-4253-81e1-22c305cbb62e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:10 devstack sudo[97048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-37e0019b-53c8-4253-81e1-22c305cbb62e
Jul 04 00:00:10 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:11 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51820102-07dd-404a-9089-34116ec0be3f" returned: 0 in 0.940s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51820102-07dd-404a-9089-34116ec0be3f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:11 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-37e0019b-53c8-4253-81e1-22c305cbb62e" returned: 0 in 0.692s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] <== create_volume: return (2354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.359s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-0135eb49-fd51-4024-b269-7baaaa8a86a3 req-c9f53bb8-12d1-4d9b-8321-1f598d692522 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.711s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:11 devstack sudo[97054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51820102-07dd-404a-9089-34116ec0be3f
Jul 04 00:00:11 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:11 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[380a77e7-70e1-4cdb-88d4-d85071e56870]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-0135eb49-fd51-4024-b269-7baaaa8a86a3 req-c9f53bb8-12d1-4d9b-8321-1f598d692522 tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bdfd1048-ecf7-4210-8279-4f67af056146 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a293af2-957d-4185-bec8-d030cc11f681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37e0019b-53c8-4253-81e1-22c305cbb62e', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf710d8-a9fe-4a0d-a877-ecbc91ddb4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:11 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Volume volume-37e0019b-53c8-4253-81e1-22c305cbb62e (37e0019b-53c8-4253-81e1-22c305cbb62e): created successfully
Jul 04 00:00:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdf710d8-a9fe-4a0d-a877-ecbc91ddb4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Flow 'volume_create_manager' (b9b88ae1-e486-45f2-9f2c-65f43dc6e292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:11 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-27f32bcb-aeee-4ab1-b2dd-3b7f01ed6471 tempest-ProjectReaderTests-427535164 None] Created volume successfully.
Jul 04 00:00:11 devstack sudo[97056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bdfd1048-ecf7-4210-8279-4f67af056146
Jul 04 00:00:11 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:12 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51820102-07dd-404a-9089-34116ec0be3f" returned: 0 in 0.713s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Lock "cinder-quobyte-51820102-07dd-404a-9089-34116ec0be3f" released by "delete_volume" :: held 1.738s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Acquiring lock "cinder-37e0019b-53c8-4253-81e1-22c305cbb62e-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Lock "cinder-37e0019b-53c8-4253-81e1-22c305cbb62e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Created reservations ['8f011459-435e-430b-ba20-cdd12e46b514', 'ffe6f8b1-b9f3-4edf-8dd7-b39a6162436e', '6aa8354b-3932-4c8b-a571-2064915a8a81', 'c00c0ea1-9f5b-4e38-9bce-f4c9f0b303f0'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Acquiring lock "cinder-quobyte-37e0019b-53c8-4253-81e1-22c305cbb62e" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Lock "cinder-quobyte-37e0019b-53c8-4253-81e1-22c305cbb62e" acquired by "delete_volume" :: waited 0.031s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb84ae6-8d01-4122-8c2c-1f762f9814c0]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-37e0019b-53c8-4253-81e1-22c305cbb62e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:12 devstack sudo[97063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:00:12 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:12 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-0135eb49-fd51-4024-b269-7baaaa8a86a3 req-c9f53bb8-12d1-4d9b-8321-1f598d692522 tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bdfd1048-ecf7-4210-8279-4f67af056146" returned: 0 in 1.034s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-0135eb49-fd51-4024-b269-7baaaa8a86a3 req-c9f53bb8-12d1-4d9b-8321-1f598d692522 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.083s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:12 devstack sudo[97062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-37e0019b-53c8-4253-81e1-22c305cbb62e
Jul 04 00:00:12 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-0135eb49-fd51-4024-b269-7baaaa8a86a3 req-c9f53bb8-12d1-4d9b-8321-1f598d692522 tempest-TestInstancesWithCinderVolumes-556844828 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-bdfd1048-ecf7-4210-8279-4f67af056146', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00811aa1-52a2-4d4a-b611-474aa09e2138', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:00:12 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-0135eb49-fd51-4024-b269-7baaaa8a86a3 req-c9f53bb8-12d1-4d9b-8321-1f598d692522 tempest-TestInstancesWithCinderVolumes-556844828 None] attachment_update completed successfully.
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Acquiring lock "cinder-25866842-0d27-44e9-84b4-e355340497bf-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Lock "cinder-25866842-0d27-44e9-84b4-e355340497bf-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Acquiring lock "cinder-quobyte-25866842-0d27-44e9-84b4-e355340497bf" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Lock "cinder-quobyte-25866842-0d27-44e9-84b4-e355340497bf" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:13 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaab868-f092-4c4f-ad4c-4d1b75d5b73e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-25866842-0d27-44e9-84b4-e355340497bf {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:13 devstack sudo[97066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-25866842-0d27-44e9-84b4-e355340497bf
Jul 04 00:00:13 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:13 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.001s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:13 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:13 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Deleted volume successfully.
Jul 04 00:00:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0c9a27ff-6ddf-4ac0-9606-760e38c3790b tempest-VolumesListAdminTestJSON-1544841865 None] Lock "cinder-51820102-07dd-404a-9089-34116ec0be3f-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:13 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-37e0019b-53c8-4253-81e1-22c305cbb62e" returned: 0 in 1.159s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-37e0019b-53c8-4253-81e1-22c305cbb62e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:13 devstack sudo[97073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-37e0019b-53c8-4253-81e1-22c305cbb62e
Jul 04 00:00:13 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:14 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-25866842-0d27-44e9-84b4-e355340497bf" returned: 0 in 1.156s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-25866842-0d27-44e9-84b4-e355340497bf {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:14 devstack sudo[97081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-25866842-0d27-44e9-84b4-e355340497bf
Jul 04 00:00:14 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:00:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 28 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:00:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:00:14 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-37e0019b-53c8-4253-81e1-22c305cbb62e" returned: 0 in 0.833s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Lock "cinder-quobyte-37e0019b-53c8-4253-81e1-22c305cbb62e" released by "delete_volume" :: held 2.060s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:14 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Created reservations ['f6915ef7-284f-4a33-b87b-0d0b51067acf', '09786a21-0599-4da4-8147-873fd304c08e', '18a1b4a4-69f3-4726-88b3-05751de944a7', 'cb0056ee-ff1c-4959-92bc-68c00e0b802c'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:14 devstack sudo[97104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:00:14 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:15 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-25866842-0d27-44e9-84b4-e355340497bf" returned: 0 in 0.789s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Lock "cinder-quobyte-25866842-0d27-44e9-84b4-e355340497bf" released by "delete_volume" :: held 2.011s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:15 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Created reservations ['cea868af-23ad-41d2-a54e-ca386a2b9abb', '09c8d50d-0227-48a3-8eae-3fd39292be2d', '8ff8ae37-6bd2-403a-b0e4-b9ad69e17b2c', '6fb8375b-e6ca-43a1-a374-86ad2b03d098'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:15 devstack sudo[97107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:00:15 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:15 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.723s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:15 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Deleted volume successfully.
Jul 04 00:00:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8e1cd680-3a99-45ce-b1ef-8e794a2930d8 tempest-ProjectReaderTests-427535164 None] Lock "cinder-37e0019b-53c8-4253-81e1-22c305cbb62e-delete_volume" released by "delete_volume" :: held 3.114s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:15 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.744s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:15 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Deleted volume successfully.
Jul 04 00:00:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6adcc891-aef6-40f3-897c-8e0b765551bd tempest-VolumesListAdminTestJSON-1544841865 None] Lock "cinder-25866842-0d27-44e9-84b4-e355340497bf-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-8ad41ecc-ac2f-4c19-9a21-cba2f67c5e47 req-5c7f00aa-e169-4fb3-8f54-5113266a86d7 tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-8ad41ecc-ac2f-4c19-9a21-cba2f67c5e47 req-5c7f00aa-e169-4fb3-8f54-5113266a86d7 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:21 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6626816-a027-4787-bb9c-4743e11621fc]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-8ad41ecc-ac2f-4c19-9a21-cba2f67c5e47 req-5c7f00aa-e169-4fb3-8f54-5113266a86d7 tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3f698d94-2755-4333-ba15-d91bb7438166 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:21 devstack sudo[97129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3f698d94-2755-4333-ba15-d91bb7438166
Jul 04 00:00:21 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:22 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-8ad41ecc-ac2f-4c19-9a21-cba2f67c5e47 req-5c7f00aa-e169-4fb3-8f54-5113266a86d7 tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3f698d94-2755-4333-ba15-d91bb7438166" returned: 0 in 1.112s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-8ad41ecc-ac2f-4c19-9a21-cba2f67c5e47 req-5c7f00aa-e169-4fb3-8f54-5113266a86d7 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.149s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-8ad41ecc-ac2f-4c19-9a21-cba2f67c5e47 req-5c7f00aa-e169-4fb3-8f54-5113266a86d7 tempest-TestInstancesWithCinderVolumes-556844828 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-3f698d94-2755-4333-ba15-d91bb7438166', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0ff38453-5b02-43ca-9ca5-80eee7715bff', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:00:22 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-8ad41ecc-ac2f-4c19-9a21-cba2f67c5e47 req-5c7f00aa-e169-4fb3-8f54-5113266a86d7 tempest-TestInstancesWithCinderVolumes-556844828 None] attachment_update completed successfully.
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Flow 'volume_create_manager' (f300b008-e601-4c71-8c3c-b659c884c5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90620222-a03a-471e-92bf-01a6530cd8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90620222-a03a-471e-92bf-01a6530cd8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-358146926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abdcc6e-c127-4aea-94f0-8f58ab5adc6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47ca2f6a66d442196bb68ecbd06dd0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:24Z,use_quota=True,user_id='33afdb65f6bc465e8c66bb01348c74b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680f1987-1718-47ab-b0f9-4068f9ab577c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (680f1987-1718-47ab-b0f9-4068f9ab577c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c836e8-5ca2-4fa7-878b-ee69292a3f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c836e8-5ca2-4fa7-878b-ee69292a3f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7abdcc6e-c127-4aea-94f0-8f58ab5adc6a', 'volume_name': 'volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84fecab0-37a9-4d54-9134-b6f3f369016d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84fecab0-37a9-4d54-9134-b6f3f369016d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecc268c-e054-479f-85e4-276109601db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:23 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Volume 7abdcc6e-c127-4aea-94f0-8f58ab5adc6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a', 'volume_size': 1}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-358146926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7abdcc6e-c127-4aea-94f0-8f58ab5adc6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47ca2f6a66d442196bb68ecbd06dd0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:24Z,use_quota=True,user_id='33afdb65f6bc465e8c66bb01348c74b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Creating volume 7abdcc6e-c127-4aea-94f0-8f58ab5adc6a {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:23 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:00:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:24 devstack sudo[97137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a 1073741824
Jul 04 00:00:24 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Flow 'volume_create_manager' (e8530a5d-5db2-4085-af06-6156ac0d2c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cea429d-f3cc-4d03-9f62-b8ca43eecb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cea429d-f3cc-4d03-9f62-b8ca43eecb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-631878318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265b1b07-a8ee-4816-ab9b-552d2eb6309d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c44b12bcded4a1dbbc99b602500e47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:25Z,use_quota=True,user_id='cf0d08b4f0424ac9980fa4b8c333ae27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7c8d7b-da80-4972-a91f-c2991949ba2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7c8d7b-da80-4972-a91f-c2991949ba2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ef37b6-fedb-4dc5-8e30-d02488186eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ef37b6-fedb-4dc5-8e30-d02488186eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '265b1b07-a8ee-4816-ab9b-552d2eb6309d', 'volume_name': 'volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da66903-ed9d-4a77-bc11-f17504f7590f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3da66903-ed9d-4a77-bc11-f17504f7590f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:25 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c393813b-2c68-4550-8777-23bfa1bf012d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:25 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Volume 265b1b07-a8ee-4816-ab9b-552d2eb6309d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d', 'volume_size': 1}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a 1073741824" returned: 0 in 1.187s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:25 devstack sudo[97145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a
Jul 04 00:00:25 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:25 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a" returned: 0 in 0.777s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.816s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-631878318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=265b1b07-a8ee-4816-ab9b-552d2eb6309d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c44b12bcded4a1dbbc99b602500e47e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:25Z,use_quota=True,user_id='cf0d08b4f0424ac9980fa4b8c333ae27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Creating volume 265b1b07-a8ee-4816-ab9b-552d2eb6309d {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:25 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:00:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:26 devstack sudo[97148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d 1073741824
Jul 04 00:00:26 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecc268c-e054-479f-85e4-276109601db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba3be4b-f3bc-4320-a26a-f9988afb3a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:26 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Volume volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a (7abdcc6e-c127-4aea-94f0-8f58ab5adc6a): created successfully
Jul 04 00:00:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba3be4b-f3bc-4320-a26a-f9988afb3a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Flow 'volume_create_manager' (f300b008-e601-4c71-8c3c-b659c884c5cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:26 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-060a633b-a4a4-4672-ab1d-fbcb8ed03c34 tempest-VolumesDeleteCascade-1215698771 None] Created volume successfully.
Jul 04 00:00:27 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d 1073741824" returned: 0 in 1.341s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:27 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:27 devstack sudo[97163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d
Jul 04 00:00:27 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Flow 'volume_create_manager' (92cfe16f-7b9c-45e4-a9e6-fa1d2472c173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ddc85cc-a477-46fc-ba1b-dbaead88d8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ddc85cc-a477-46fc-ba1b-dbaead88d8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-60882491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9463d8-5499-4d28-a700-cfc0c4443917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd61f1bf27214615987c3d0a1d55d244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:27Z,use_quota=True,user_id='e77a04d7dae544b68b2499106760816e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2662f6fc-c2a8-4276-8a80-53bb0fb1dbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2662f6fc-c2a8-4276-8a80-53bb0fb1dbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed2a2a0-6230-49d4-9a19-11a225386547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eed2a2a0-6230-49d4-9a19-11a225386547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b9463d8-5499-4d28-a700-cfc0c4443917', 'volume_name': 'volume-7b9463d8-5499-4d28-a700-cfc0c4443917', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2454ce5f-0cd8-449b-a06e-c444871abbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2454ce5f-0cd8-449b-a06e-c444871abbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539e8095-d625-4554-9f36-7df65e6f0582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:27 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Volume 7b9463d8-5499-4d28-a700-cfc0c4443917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b9463d8-5499-4d28-a700-cfc0c4443917', 'volume_size': 1}
Jul 04 00:00:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:28 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d" returned: 0 in 0.909s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] <== create_volume: return (2360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.362s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-60882491',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9463d8-5499-4d28-a700-cfc0c4443917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd61f1bf27214615987c3d0a1d55d244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:27Z,use_quota=True,user_id='e77a04d7dae544b68b2499106760816e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Creating volume 7b9463d8-5499-4d28-a700-cfc0c4443917 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:28 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b9463d8-5499-4d28-a700-cfc0c4443917 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:28 devstack sudo[97166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b9463d8-5499-4d28-a700-cfc0c4443917 1073741824
Jul 04 00:00:28 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c393813b-2c68-4550-8777-23bfa1bf012d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d41ab52-c4e0-4586-a6d7-194552054ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:28 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Volume volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d (265b1b07-a8ee-4816-ab9b-552d2eb6309d): created successfully
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d41ab52-c4e0-4586-a6d7-194552054ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Flow 'volume_create_manager' (e8530a5d-5db2-4085-af06-6156ac0d2c7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:28 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-d1f02a19-d87e-431f-8cfc-9a8fe875034e tempest-AttachVolumeNegativeTest-608528329 None] Created volume successfully.
Jul 04 00:00:29 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b9463d8-5499-4d28-a700-cfc0c4443917 1073741824" returned: 0 in 1.151s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b9463d8-5499-4d28-a700-cfc0c4443917 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:29 devstack sudo[97181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b9463d8-5499-4d28-a700-cfc0c4443917
Jul 04 00:00:29 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:30 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b9463d8-5499-4d28-a700-cfc0c4443917" returned: 0 in 0.739s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.605s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539e8095-d625-4554-9f36-7df65e6f0582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b9463d8-5499-4d28-a700-cfc0c4443917', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be600800-7e8a-4d33-9cad-0cdd4596ace1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] Creating offline snapshot c152ff0d-dc08-47ba-93b7-95afa202b038 of volume 7abdcc6e-c127-4aea-94f0-8f58ab5adc6a {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:00:30 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Volume volume-7b9463d8-5499-4d28-a700-cfc0c4443917 (7b9463d8-5499-4d28-a700-cfc0c4443917): created successfully
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be600800-7e8a-4d33-9cad-0cdd4596ace1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Flow 'volume_create_manager' (92cfe16f-7b9c-45e4-a9e6-fa1d2472c173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[93eddb57-1f50-4ee4-96bb-c297a43e399b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:30 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-1ad61b7f-d4f3-4ed1-ade1-1504df06d538 tempest-ProjectReaderTests-328152503 None] Created volume successfully.
Jul 04 00:00:30 devstack sudo[97200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a
Jul 04 00:00:30 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Acquiring lock "cinder-7b9463d8-5499-4d28-a700-cfc0c4443917-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Lock "cinder-7b9463d8-5499-4d28-a700-cfc0c4443917-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Acquiring lock "cinder-quobyte-7b9463d8-5499-4d28-a700-cfc0c4443917" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Lock "cinder-quobyte-7b9463d8-5499-4d28-a700-cfc0c4443917" acquired by "delete_volume" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f8a7ab-0b4d-4535-8459-21f2e1e29820]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b9463d8-5499-4d28-a700-cfc0c4443917 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:31 devstack sudo[97202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b9463d8-5499-4d28-a700-cfc0c4443917
Jul 04 00:00:31 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:31 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a" returned: 0 in 1.009s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:31 devstack sudo[97207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038 1G
Jul 04 00:00:31 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:31 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b9463d8-5499-4d28-a700-cfc0c4443917" returned: 0 in 0.849s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b9463d8-5499-4d28-a700-cfc0c4443917 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:31 devstack sudo[97212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b9463d8-5499-4d28-a700-cfc0c4443917
Jul 04 00:00:31 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:32 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-23cd22a1-97f5-4c9b-abe2-2c3a22ee3353 req-322e95c6-8438-40c9-82ac-b34ce00e6e0c tempest-TestInstancesWithCinderVolumes-556844828 None] Terminate volume connection completed successfully.
Jul 04 00:00:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-23cd22a1-97f5-4c9b-abe2-2c3a22ee3353 req-322e95c6-8438-40c9-82ac-b34ce00e6e0c tempest-TestInstancesWithCinderVolumes-556844828 None] Deleting attachment 00811aa1-52a2-4d4a-b611-474aa09e2138. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:00:32 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038 1G" returned: 0 in 0.998s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:32 devstack sudo[97228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038
Jul 04 00:00:32 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-59bfc12c-809a-4e8b-a2b4-dac2a26799f1 req-ab9bb11b-a3a2-4d10-b9ec-48669891ffee tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:32 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b9463d8-5499-4d28-a700-cfc0c4443917" returned: 0 in 0.783s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Lock "cinder-quobyte-7b9463d8-5499-4d28-a700-cfc0c4443917" released by "delete_volume" :: held 1.676s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:32 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Created reservations ['f77ee72d-1ed3-48b4-9a91-8d3dc94ef7ea', '24e9f98e-b3b3-47f9-86be-73c2c843e4a5', 'e57a350d-d257-4651-86ce-92fffbe746c3', '1bfa8c80-8109-4abc-b8e2-73256fe0a76b'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:32 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:32 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:32 devstack sudo[97231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:00:32 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:33 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038" returned: 0 in 0.786s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:33 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038 is being set with open permissions: ugo+rw
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:33 devstack sudo[97236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038
Jul 04 00:00:33 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:33 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.832s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:33 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Deleted volume successfully.
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Flow 'volume_create_manager' (e11420bc-5d14-4e33-a69d-0893bd2011eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae6e5d1c-fe22-46f8-bc8d-5b5e368d66a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9e7425c9-0134-4366-85a5-cb8184dab559 tempest-ProjectReaderTests-328152503 None] Lock "cinder-7b9463d8-5499-4d28-a700-cfc0c4443917-delete_volume" released by "delete_volume" :: held 2.845s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae6e5d1c-fe22-46f8-bc8d-5b5e368d66a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1491062987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a0eb9b-2e2f-496a-aac4-3dcea5c0d643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd61f1bf27214615987c3d0a1d55d244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:34Z,use_quota=True,user_id='e77a04d7dae544b68b2499106760816e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c9d599-7877-4c1e-8630-4c8317303b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c9d599-7877-4c1e-8630-4c8317303b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdba47a1-cf32-476a-8d30-205829ce2f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdba47a1-cf32-476a-8d30-205829ce2f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07a0eb9b-2e2f-496a-aac4-3dcea5c0d643', 'volume_name': 'volume-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f028b0d1-4c1a-4bd0-baf0-b0eb6e1e130a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f028b0d1-4c1a-4bd0-baf0-b0eb6e1e130a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0780bc01-1d27-4afa-bddc-ccffd25db30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:33 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Volume 07a0eb9b-2e2f-496a-aac4-3dcea5c0d643: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643', 'volume_size': 1}
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:33 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038" returned: 0 in 0.757s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:34 devstack sudo[97241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.info
Jul 04 00:00:34 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "cinder-bdfd1048-ecf7-4210-8279-4f67af056146-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "cinder-bdfd1048-ecf7-4210-8279-4f67af056146-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "cinder-quobyte-bdfd1048-ecf7-4210-8279-4f67af056146" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "cinder-quobyte-bdfd1048-ecf7-4210-8279-4f67af056146" acquired by "delete_volume" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:34 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a300d53c-0df7-4db8-aca1-7d47590d3368]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bdfd1048-ecf7-4210-8279-4f67af056146 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:34 devstack sudo[97247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bdfd1048-ecf7-4210-8279-4f67af056146
Jul 04 00:00:34 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:34 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.info" returned: 0 in 0.899s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:34 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.info is being set with open permissions: ugo+rw
Jul 04 00:00:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:34 devstack sudo[97250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.info
Jul 04 00:00:34 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:35 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bdfd1048-ecf7-4210-8279-4f67af056146" returned: 0 in 0.905s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bdfd1048-ecf7-4210-8279-4f67af056146 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:35 devstack sudo[97255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bdfd1048-ecf7-4210-8279-4f67af056146
Jul 04 00:00:35 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:35 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.info" returned: 0 in 0.752s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.349s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-59bfc12c-809a-4e8b-a2b4-dac2a26799f1 req-ab9bb11b-a3a2-4d10-b9ec-48669891ffee tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.228s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:35 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[04641728-8526-4276-99ec-4c5308e9953d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-59bfc12c-809a-4e8b-a2b4-dac2a26799f1 req-ab9bb11b-a3a2-4d10-b9ec-48669891ffee tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:35 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-97ec4457-ab96-4643-b92a-dbdadb55ffc5 tempest-VolumesDeleteCascade-1215698771 None] Create snapshot completed successfully
Jul 04 00:00:35 devstack sudo[97259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d
Jul 04 00:00:35 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:35 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bdfd1048-ecf7-4210-8279-4f67af056146" returned: 0 in 0.856s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "cinder-quobyte-bdfd1048-ecf7-4210-8279-4f67af056146" released by "delete_volume" :: held 1.818s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:36 devstack cinder-volume[86650]: WARNING cinder.quota [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-790078100-934222938 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-790078100-934222938, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:00:36 devstack cinder-volume[86650]: WARNING cinder.quota [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-790078100-934222938 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-790078100-934222938, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Created reservations ['f2a71f0b-a535-4d7e-a56b-716d38c71033', 'eb6507bd-e693-4d73-b06d-de8ded34fb83', '0082be22-247a-4e43-8eaa-37676efba8c3', '5389e184-5bad-41a5-bc9a-33edec0201d2'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:36 devstack sudo[97262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:00:36 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-96cc4cb1-3789-4b46-be3d-bbba9c9caea5 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:36 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-59bfc12c-809a-4e8b-a2b4-dac2a26799f1 req-ab9bb11b-a3a2-4d10-b9ec-48669891ffee tempest-AttachVolumeNegativeTest-608528329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d" returned: 0 in 1.204s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-59bfc12c-809a-4e8b-a2b4-dac2a26799f1 req-ab9bb11b-a3a2-4d10-b9ec-48669891ffee tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.237s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.179s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1491062987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a0eb9b-2e2f-496a-aac4-3dcea5c0d643,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd61f1bf27214615987c3d0a1d55d244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:34Z,use_quota=True,user_id='e77a04d7dae544b68b2499106760816e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Creating volume 07a0eb9b-2e2f-496a-aac4-3dcea5c0d643 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:36 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:36 devstack sudo[97275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643 1073741824
Jul 04 00:00:36 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-59bfc12c-809a-4e8b-a2b4-dac2a26799f1 req-ab9bb11b-a3a2-4d10-b9ec-48669891ffee tempest-AttachVolumeNegativeTest-608528329 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a8c854e-917f-4cc4-9637-0bd444c04736', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:00:37 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-59bfc12c-809a-4e8b-a2b4-dac2a26799f1 req-ab9bb11b-a3a2-4d10-b9ec-48669891ffee tempest-AttachVolumeNegativeTest-608528329 None] attachment_update completed successfully.
Jul 04 00:00:37 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.900s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:37 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:37 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Deleted volume successfully.
Jul 04 00:00:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-12e24c05-72bb-4e38-8ef0-0a5b86198300 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "cinder-bdfd1048-ecf7-4210-8279-4f67af056146-delete_volume" released by "delete_volume" :: held 3.091s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:38 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643 1073741824" returned: 0 in 1.219s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:38 devstack sudo[97298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643
Jul 04 00:00:38 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:38 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643" returned: 0 in 0.779s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] <== create_volume: return (2043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-96cc4cb1-3789-4b46-be3d-bbba9c9caea5 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.623s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0780bc01-1d27-4afa-bddc-ccffd25db30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd24bdf2-03a6-4de3-bd71-5cc6d3da5118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-96cc4cb1-3789-4b46-be3d-bbba9c9caea5 tempest-VolumesDeleteCascade-1215698771 None] Creating offline snapshot e874da2a-d3ee-4d14-ac58-5723acdaa4f2 of volume 7abdcc6e-c127-4aea-94f0-8f58ab5adc6a {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:00:39 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Volume volume-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643 (07a0eb9b-2e2f-496a-aac4-3dcea5c0d643): created successfully
Jul 04 00:00:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd24bdf2-03a6-4de3-bd71-5cc6d3da5118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Flow 'volume_create_manager' (e11420bc-5d14-4e33-a69d-0893bd2011eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:39 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1ffdf4-3bac-4c88-be50-4b3c2c451f19]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-96cc4cb1-3789-4b46-be3d-bbba9c9caea5 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:39 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-489b34dd-b1b3-42fa-9b1b-ec9e7b2fa252 tempest-ProjectReaderTests-328152503 None] Created volume successfully.
Jul 04 00:00:39 devstack sudo[97301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038
Jul 04 00:00:39 devstack sudo[97301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:39 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-d656d6b1-2021-48c6-94a0-f08c9b0170e9 req-676e7fa7-4c14-45a6-bc5a-672e78fd4a1f tempest-TestInstancesWithCinderVolumes-556844828 None] Terminate volume connection completed successfully.
Jul 04 00:00:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-d656d6b1-2021-48c6-94a0-f08c9b0170e9 req-676e7fa7-4c14-45a6-bc5a-672e78fd4a1f tempest-TestInstancesWithCinderVolumes-556844828 None] Deleting attachment 0ff38453-5b02-43ca-9ca5-80eee7715bff. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:00:40 devstack sudo[97301]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-96cc4cb1-3789-4b46-be3d-bbba9c9caea5 tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038" returned: 0 in 1.049s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-96cc4cb1-3789-4b46-be3d-bbba9c9caea5 tempest-VolumesDeleteCascade-1215698771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:00:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-96cc4cb1-3789-4b46-be3d-bbba9c9caea5 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:40 devstack sudo[97308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2 1G
Jul 04 00:00:40 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Acquiring lock "cinder-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Lock "cinder-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Acquiring lock "cinder-quobyte-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Lock "cinder-quobyte-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643" acquired by "delete_volume" :: waited 0.034s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:40 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb9584d-6aef-4b34-88dd-aec4b280c155]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:40 devstack sudo[97310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643
Jul 04 00:00:40 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:41 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-96cc4cb1-3789-4b46-be3d-bbba9c9caea5 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2 1G" returned: 0 in 1.125s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-96cc4cb1-3789-4b46-be3d-bbba9c9caea5 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:41 devstack sudo[97319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2
Jul 04 00:00:41 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:41 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643" returned: 0 in 0.970s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:41 devstack sudo[97321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643
Jul 04 00:00:41 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "cinder-3f698d94-2755-4333-ba15-d91bb7438166-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "cinder-3f698d94-2755-4333-ba15-d91bb7438166-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "cinder-quobyte-3f698d94-2755-4333-ba15-d91bb7438166" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "cinder-quobyte-3f698d94-2755-4333-ba15-d91bb7438166" acquired by "delete_volume" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:41 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8ab3a9-5ccc-435c-9374-183eef95ea26]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3f698d94-2755-4333-ba15-d91bb7438166 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:42 devstack sudo[97323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3f698d94-2755-4333-ba15-d91bb7438166
Jul 04 00:00:42 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:42 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-96cc4cb1-3789-4b46-be3d-bbba9c9caea5 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2" returned: 0 in 1.021s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:42 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-96cc4cb1-3789-4b46-be3d-bbba9c9caea5 tempest-VolumesDeleteCascade-1215698771 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2 is being set with open permissions: ugo+rw
Jul 04 00:00:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-96cc4cb1-3789-4b46-be3d-bbba9c9caea5 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:42 devstack sudo[97329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2
Jul 04 00:00:42 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:42 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643" returned: 0 in 1.274s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Lock "cinder-quobyte-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643" released by "delete_volume" :: held 2.301s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:42 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Created reservations ['6a06b6b1-20f6-4900-be2c-0b1ec6dec0f7', '98d3a351-9936-4a30-9a02-8e1ad27569de', 'da469381-b463-42b7-a9d1-5df442892d4a', 'dcf426c2-d420-4fac-a4b3-7fd617c886c3'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:43 devstack sudo[97335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:00:43 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:43 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3f698d94-2755-4333-ba15-d91bb7438166" returned: 0 in 1.349s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3f698d94-2755-4333-ba15-d91bb7438166 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:43 devstack sudo[97339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3f698d94-2755-4333-ba15-d91bb7438166
Jul 04 00:00:43 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:43 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-96cc4cb1-3789-4b46-be3d-bbba9c9caea5 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2" returned: 0 in 1.074s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-96cc4cb1-3789-4b46-be3d-bbba9c9caea5 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.449s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:43 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-96cc4cb1-3789-4b46-be3d-bbba9c9caea5 tempest-VolumesDeleteCascade-1215698771 None] Create snapshot completed successfully
Jul 04 00:00:43 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-da719ff4-2044-4d13-9b1b-ccfcb58a3247 req-27a45575-48c5-4c59-a48c-38a381b4d2c8 tempest-AttachVolumeNegativeTest-608528329 None] Terminate volume connection completed successfully.
Jul 04 00:00:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-da719ff4-2044-4d13-9b1b-ccfcb58a3247 req-27a45575-48c5-4c59-a48c-38a381b4d2c8 tempest-AttachVolumeNegativeTest-608528329 None] Deleting attachment 8a8c854e-917f-4cc4-9637-0bd444c04736. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:00:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Performing cascade delete. {{(pid=86650) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 04 00:00:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-c152ff0d-dc08-47ba-93b7-95afa202b038-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-c152ff0d-dc08-47ba-93b7-95afa202b038-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-quobyte-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:43 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.007s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:43 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-quobyte-c152ff0d-dc08-47ba-93b7-95afa202b038" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Deleted volume successfully.
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-c152ff0d-dc08-47ba-93b7-95afa202b038" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Deleting offline snapshot c152ff0d-dc08-47ba-93b7-95afa202b038 of volume 7abdcc6e-c127-4aea-94f0-8f58ab5adc6a {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] snapshot_file for this snap is: volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda6baf7-7a51-4ebc-ab6a-674e52c448a7]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-da47cb12-08fa-43f2-bada-3ba5c93ad99a tempest-ProjectReaderTests-328152503 None] Lock "cinder-07a0eb9b-2e2f-496a-aac4-3dcea5c0d643-delete_volume" released by "delete_volume" :: held 3.817s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:44 devstack sudo[97347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038
Jul 04 00:00:44 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:44 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3f698d94-2755-4333-ba15-d91bb7438166" returned: 0 in 1.133s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "cinder-quobyte-3f698d94-2755-4333-ba15-d91bb7438166" released by "delete_volume" :: held 2.574s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:44 devstack cinder-volume[86650]: WARNING cinder.quota [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-767219506-1252712410 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-767219506-1252712410, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:00:44 devstack cinder-volume[86650]: WARNING cinder.quota [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-767219506-1252712410 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-767219506-1252712410, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Created reservations ['168859e0-ddef-484e-97a3-d1f09d933470', '2eff3d03-c8c5-4e69-b3cf-46dbed2bd1eb', 'cda94c38-c594-48bb-82cd-bd1d94479285', '1dcfe273-96f1-4d4c-8219-8cf4e29c8c5b'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:44 devstack sudo[97349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:00:44 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Flow 'volume_create_manager' (a7af492b-8785-409b-ad07-7a6d260d45b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6c355e-19ba-45e8-a45b-5735ea19c210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e6c355e-19ba-45e8-a45b-5735ea19c210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1896600615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7886c155-8450-4ffe-94bb-b4f18f272f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd61f1bf27214615987c3d0a1d55d244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:45Z,use_quota=True,user_id='e77a04d7dae544b68b2499106760816e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65376250-c6cc-4c8d-80c7-0726e1ce9d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65376250-c6cc-4c8d-80c7-0726e1ce9d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f17e11b-d5f5-43ac-90eb-e92fc09f4234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f17e11b-d5f5-43ac-90eb-e92fc09f4234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7886c155-8450-4ffe-94bb-b4f18f272f3a', 'volume_name': 'volume-7886c155-8450-4ffe-94bb-b4f18f272f3a', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9489fc-1f89-43d2-80f1-3df4f943999e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9489fc-1f89-43d2-80f1-3df4f943999e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd378ea1-31bb-452d-b6b6-24a441bc4b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:45 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Volume 7886c155-8450-4ffe-94bb-b4f18f272f3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7886c155-8450-4ffe-94bb-b4f18f272f3a', 'volume_size': 1}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1896600615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7886c155-8450-4ffe-94bb-b4f18f272f3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd61f1bf27214615987c3d0a1d55d244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:45Z,use_quota=True,user_id='e77a04d7dae544b68b2499106760816e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Creating volume 7886c155-8450-4ffe-94bb-b4f18f272f3a {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:45 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7886c155-8450-4ffe-94bb-b4f18f272f3a 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:45 devstack sudo[97351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7886c155-8450-4ffe-94bb-b4f18f272f3a 1073741824
Jul 04 00:00:45 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:45 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038" returned: 0 in 1.322s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e67c82-3ac2-4a91-9b5b-2cd18af4364e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:45 devstack sudo[97356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a
Jul 04 00:00:45 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:45 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.207s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:45 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Deleted volume successfully.
Jul 04 00:00:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-dbf7c65e-7537-4f63-ba55-88b1754a4262 tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "cinder-3f698d94-2755-4333-ba15-d91bb7438166-delete_volume" released by "delete_volume" :: held 4.265s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:46 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7886c155-8450-4ffe-94bb-b4f18f272f3a 1073741824" returned: 0 in 1.232s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7886c155-8450-4ffe-94bb-b4f18f272f3a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:46 devstack sudo[97365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7886c155-8450-4ffe-94bb-b4f18f272f3a
Jul 04 00:00:46 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:46 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a" returned: 0 in 1.215s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:46 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab986a10-1fbf-4557-9311-c13e4a1a486f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:46 devstack sudo[97370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2
Jul 04 00:00:46 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:47 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7886c155-8450-4ffe-94bb-b4f18f272f3a" returned: 0 in 0.869s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] <== create_volume: return (2180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.189s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd378ea1-31bb-452d-b6b6-24a441bc4b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7886c155-8450-4ffe-94bb-b4f18f272f3a', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a282e4a-62ae-4919-ab75-33dcc268a372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:47 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Volume volume-7886c155-8450-4ffe-94bb-b4f18f272f3a (7886c155-8450-4ffe-94bb-b4f18f272f3a): created successfully
Jul 04 00:00:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a282e4a-62ae-4919-ab75-33dcc268a372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Flow 'volume_create_manager' (a7af492b-8785-409b-ad07-7a6d260d45b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:47 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3444eda8-0adb-4ff6-a87e-6327ec06ca90 tempest-ProjectReaderTests-328152503 None] Created volume successfully.
Jul 04 00:00:47 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2" returned: 0 in 1.240s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:00:48 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[282b0992-c0df-43fc-8479-f2f168ecef87]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:48 devstack sudo[97437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038
Jul 04 00:00:48 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Acquiring lock "cinder-7886c155-8450-4ffe-94bb-b4f18f272f3a-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Lock "cinder-7886c155-8450-4ffe-94bb-b4f18f272f3a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Acquiring lock "cinder-quobyte-7886c155-8450-4ffe-94bb-b4f18f272f3a" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Lock "cinder-quobyte-7886c155-8450-4ffe-94bb-b4f18f272f3a" acquired by "delete_volume" :: waited 0.027s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:48 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[41af0daf-eb5c-4e06-9b3f-7e96b272e2fc]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7886c155-8450-4ffe-94bb-b4f18f272f3a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:48 devstack sudo[97454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7886c155-8450-4ffe-94bb-b4f18f272f3a
Jul 04 00:00:48 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:49 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038" returned: 0 in 1.241s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:00:49 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0601d5-9dcc-4a75-b4b0-4c96b9299803]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:49 devstack sudo[97461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a
Jul 04 00:00:49 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:49 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7886c155-8450-4ffe-94bb-b4f18f272f3a" returned: 0 in 1.191s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7886c155-8450-4ffe-94bb-b4f18f272f3a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:49 devstack sudo[97470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7886c155-8450-4ffe-94bb-b4f18f272f3a
Jul 04 00:00:49 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:50 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a" returned: 0 in 1.196s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:50 devstack sudo[97476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038
Jul 04 00:00:50 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:50 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7886c155-8450-4ffe-94bb-b4f18f272f3a" returned: 0 in 0.708s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:50 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Lock "cinder-quobyte-7886c155-8450-4ffe-94bb-b4f18f272f3a" released by "delete_volume" :: held 1.962s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:50 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Created reservations ['0ab3be99-55b0-40f1-be8a-7c65893b8c6a', '0f127acb-82f9-492c-ad4a-e3bfce93fd64', '5c4f433c-a0ac-489b-8a1d-d60059dcdc3a', 'b32e83a3-34a0-4cda-aad4-4963c8015f74'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:50 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-de12f697-adbd-400f-a391-d8e05f284cf1 req-cab4e0ad-1010-45da-b5e0-37cc508694dd tempest-TestInstancesWithCinderVolumes-556844828 None] Terminate volume connection completed successfully.
Jul 04 00:00:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-de12f697-adbd-400f-a391-d8e05f284cf1 req-cab4e0ad-1010-45da-b5e0-37cc508694dd tempest-TestInstancesWithCinderVolumes-556844828 None] Deleting attachment 1c3a0146-425b-41aa-8075-b234535c80e5. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:00:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:50 devstack sudo[97479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:00:50 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:51 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038" returned: 0 in 0.944s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:51 devstack sudo[97484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038
Jul 04 00:00:51 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Flow 'volume_create_manager' (d1bef098-5779-421c-910f-0079f62da462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd564ce-9ec0-430c-9505-a66f066966a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd564ce-9ec0-430c-9505-a66f066966a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1300220157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd61f1bf27214615987c3d0a1d55d244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:51Z,use_quota=True,user_id='e77a04d7dae544b68b2499106760816e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc177f5b-6e90-4299-8882-d23e7eb0cd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc177f5b-6e90-4299-8882-d23e7eb0cd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7403ae-85d6-4af3-8d16-e9a64dd43cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b7403ae-85d6-4af3-8d16-e9a64dd43cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3', 'volume_name': 'volume-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405aeb52-df89-456c-85a7-c540d375cf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405aeb52-df89-456c-85a7-c540d375cf56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22031c90-7836-4d29-b9a4-2f17512a2f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:51 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Volume ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3', 'volume_size': 1}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1300220157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd61f1bf27214615987c3d0a1d55d244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:00:51Z,use_quota=True,user_id='e77a04d7dae544b68b2499106760816e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Creating volume ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:00:51 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:51 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.798s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:51 devstack sudo[97487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3 1073741824
Jul 04 00:00:51 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:51 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Deleted volume successfully.
Jul 04 00:00:51 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-56c84672-6704-4a12-b24f-903d100c7f4d tempest-ProjectReaderTests-328152503 None] Lock "cinder-7886c155-8450-4ffe-94bb-b4f18f272f3a-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:52 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.c152ff0d-dc08-47ba-93b7-95afa202b038" returned: 0 in 0.720s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2 -F qcow2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:52 devstack sudo[97490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2 -F qcow2
Jul 04 00:00:52 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:52 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3 1073741824" returned: 0 in 0.975s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:52 devstack sudo[97496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3
Jul 04 00:00:52 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:53 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2 -F qcow2" returned: 0 in 0.900s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-c152ff0d-dc08-47ba-93b7-95afa202b038" released by "_delete_snapshot" :: held 9.035s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a" released by "delete_snapshot" :: held 9.081s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Created reservations ['ed2787d1-2853-4c54-9eb0-510078cd6ced', '2223ab72-7130-4c18-ba16-9518515d3e6e', 'a7101921-4bdf-467f-a4b3-6d709d4b8e4f', '3c88261d-113f-4670-81b8-35c520ac7c38'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:53 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Delete snapshot completed successfully.
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-c152ff0d-dc08-47ba-93b7-95afa202b038-delete_snapshot" released by "delete_snapshot" :: held 9.287s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-e874da2a-d3ee-4d14-ac58-5723acdaa4f2-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-e874da2a-d3ee-4d14-ac58-5723acdaa4f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-quobyte-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-quobyte-e874da2a-d3ee-4d14-ac58-5723acdaa4f2" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-e874da2a-d3ee-4d14-ac58-5723acdaa4f2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Deleting offline snapshot e874da2a-d3ee-4d14-ac58-5723acdaa4f2 of volume 7abdcc6e-c127-4aea-94f0-8f58ab5adc6a {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] snapshot_file for this snap is: volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[53053a40-2827-4601-a78f-78fa5d7e03a4]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:53 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3" returned: 0 in 0.763s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] <== create_volume: return (1894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22031c90-7836-4d29-b9a4-2f17512a2f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb6fdaf-11e1-4ce4-bb59-b7564315ad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:00:53 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Volume volume-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3 (ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3): created successfully
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb6fdaf-11e1-4ce4-bb59-b7564315ad21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:00:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Flow 'volume_create_manager' (d1bef098-5779-421c-910f-0079f62da462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:00:53 devstack sudo[97503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2
Jul 04 00:00:53 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:53 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-b80c660c-4669-47b6-bc02-ce9d00615e94 tempest-ProjectReaderTests-328152503 None] Created volume successfully.
Jul 04 00:00:54 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2" returned: 0 in 0.927s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:00:54 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7f28b8-8324-4f9a-8e1d-bbced40fac35]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:54 devstack sudo[97508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a
Jul 04 00:00:54 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "cinder-c881a100-e11c-47e9-a4e9-55f7ccf590fb-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Acquiring lock "cinder-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "cinder-c881a100-e11c-47e9-a4e9-55f7ccf590fb-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Lock "cinder-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "cinder-quobyte-c881a100-e11c-47e9-a4e9-55f7ccf590fb" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "cinder-quobyte-c881a100-e11c-47e9-a4e9-55f7ccf590fb" acquired by "delete_volume" :: waited 0.031s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Acquiring lock "cinder-quobyte-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:55 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[caabba7a-2ffd-4dc9-8378-92e2be8b9d01]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Lock "cinder-quobyte-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3" acquired by "delete_volume" :: waited 0.032s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:55 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c2418d-f299-4cf6-9dc3-989da54d6314]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:55 devstack sudo[97510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb
Jul 04 00:00:55 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:55 devstack sudo[97511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3
Jul 04 00:00:55 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:55 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a" returned: 0 in 1.124s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:55 devstack sudo[97517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2
Jul 04 00:00:55 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:56 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb" returned: 0 in 1.003s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "cinder-265b1b07-a8ee-4816-ab9b-552d2eb6309d-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:56 devstack sudo[97523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb
Jul 04 00:00:56 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Lock "cinder-265b1b07-a8ee-4816-ab9b-552d2eb6309d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=133,cinder:SELECT=112,cinder:INSERT=19,cinder:DELETE=9 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=111,cinder:INSERT=40,cinder:UPDATE=133,cinder:DELETE=14 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "cinder-quobyte-265b1b07-a8ee-4816-ab9b-552d2eb6309d" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:56 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Lock "cinder-quobyte-265b1b07-a8ee-4816-ab9b-552d2eb6309d" acquired by "delete_volume" :: waited 0.035s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3" returned: 0 in 1.202s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[609de9ca-dee8-49a7-bf78-50a79f3fe1c2]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:56 devstack sudo[97533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3
Jul 04 00:00:56 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:56 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2" returned: 0 in 0.974s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:56 devstack sudo[97539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2
Jul 04 00:00:56 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:56 devstack sudo[97534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d
Jul 04 00:00:56 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:56 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb" returned: 1 in 0.921s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:00:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:57 devstack sudo[97546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb
Jul 04 00:00:57 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:57 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3" returned: 0 in 0.783s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Lock "cinder-quobyte-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3" released by "delete_volume" :: held 2.083s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:57 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a.e874da2a-d3ee-4d14-ac58-5723acdaa4f2" returned: 0 in 0.854s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-e874da2a-d3ee-4d14-ac58-5723acdaa4f2" released by "_delete_snapshot" :: held 4.021s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a" released by "delete_snapshot" :: held 4.054s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Created reservations ['fa7117dd-f21d-4da9-8f51-0efcadac74f7', '32562acd-5270-4439-937c-b8c3cfd63aec', '920a6390-42ca-44e2-b7d2-7e0c11d01972', '85b69bdb-81c4-4df0-9ed2-8466794d9748'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:57 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d" returned: 0 in 1.010s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:57 devstack sudo[97553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d
Jul 04 00:00:57 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Created reservations ['336fd975-65d9-454e-a367-7204f3e1e859', 'f33cf4b8-b122-4380-b7ea-8c5dfa0c2a6e', '4afc4570-2c78-491c-af04-7299a827435d', 'dbbcaef0-3b22-4339-a38f-1e8e6d30791f'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:57 devstack sudo[97555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:00:57 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:57 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Delete snapshot completed successfully.
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-e874da2a-d3ee-4d14-ac58-5723acdaa4f2-delete_snapshot" released by "delete_snapshot" :: held 4.519s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Snapshots deleted, issuing volume delete {{(pid=86650) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-quobyte-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a" acquired by "delete_volume" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73f0439-075c-419d-ab16-c7ec6f735eba]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:57 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c881a100-e11c-47e9-a4e9-55f7ccf590fb" returned: 0 in 0.883s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "cinder-quobyte-c881a100-e11c-47e9-a4e9-55f7ccf590fb" released by "delete_volume" :: held 2.926s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:57 devstack cinder-volume[86650]: WARNING cinder.quota [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1997565535-831087276 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1997565535-831087276, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:00:57 devstack cinder-volume[86650]: WARNING cinder.quota [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1997565535-831087276 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1997565535-831087276, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:00:57 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Created reservations ['899bca98-055d-4ed7-b5f0-cdd850b17479', 'b16eac5a-8cd8-4c69-9106-9ac7df391937', 'f54aa06b-34c0-4e6b-b383-5692d1fcb4f1', 'a17ba0db-a557-487a-bcf1-bfb7d8c31840'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:57 devstack sudo[97558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a
Jul 04 00:00:57 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:58 devstack sudo[97561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:00:58 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:58 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-265b1b07-a8ee-4816-ab9b-552d2eb6309d" returned: 0 in 0.789s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Lock "cinder-quobyte-265b1b07-a8ee-4816-ab9b-552d2eb6309d" released by "delete_volume" :: held 1.881s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Created reservations ['32b70eba-925b-4f19-b2c0-3184d5807bfd', '60c34141-8dc7-40b6-aceb-c5e1611d15db', '94f76723-b8bf-4389-a373-a31f723991d4', 'd53ec063-f575-40ba-bec1-0f65ab377ec9'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:58 devstack sudo[97563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:00:58 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "cinder-bc031608-d602-4ec5-94fb-8768eafaf0c2-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:58 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Lock "cinder-bc031608-d602-4ec5-94fb-8768eafaf0c2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.146s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:58 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Deleted volume successfully.
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a59ee1df-b75c-4bf0-9ec0-febe5e3e3cf9 tempest-ProjectReaderTests-328152503 None] Lock "cinder-ccd3a08e-7ead-4884-a87b-b5ab1e17f4f3-delete_volume" released by "delete_volume" :: held 4.017s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "cinder-quobyte-bc031608-d602-4ec5-94fb-8768eafaf0c2" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:00:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Lock "cinder-quobyte-bc031608-d602-4ec5-94fb-8768eafaf0c2" acquired by "delete_volume" :: waited 0.041s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:00:59 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a393d3-16dc-41f4-8e7d-37ecba037bf2]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:00:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc031608-d602-4ec5-94fb-8768eafaf0c2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:59 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a" returned: 0 in 1.427s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:00:59 devstack sudo[97569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc031608-d602-4ec5-94fb-8768eafaf0c2
Jul 04 00:00:59 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:59 devstack sudo[97571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a
Jul 04 00:00:59 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:00:59 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.348s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:59 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:59 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Deleted volume successfully.
Jul 04 00:00:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-610dcf0a-e0b7-4bfe-89d0-33fe856e7e1f tempest-TestInstancesWithCinderVolumes-556844828 None] Lock "cinder-c881a100-e11c-47e9-a4e9-55f7ccf590fb-delete_volume" released by "delete_volume" :: held 4.640s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:00:59 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root
Jul 04 00:00:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.383s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:00:59 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:00:59 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Deleted volume successfully.
Jul 04 00:00:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-14a8ddc7-61e5-408e-b066-f242ff318017 tempest-AttachVolumeNegativeTest-608528329 None] Lock "cinder-265b1b07-a8ee-4816-ab9b-552d2eb6309d-delete_volume" released by "delete_volume" :: held 3.738s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:00 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a" returned: 0 in 1.053s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:00 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a" released by "delete_volume" :: held 2.549s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:00 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Created reservations ['80f31ef4-cade-429e-98be-a8f927c82201', '0cca9b41-3beb-48f4-8b1f-d054712a6045', 'badd7a68-fe02-46ea-9042-403cf72dbc8e', '347e28db-4f8d-4502-aae5-170659a85260'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:00 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc031608-d602-4ec5-94fb-8768eafaf0c2" returned: 0 in 1.459s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc031608-d602-4ec5-94fb-8768eafaf0c2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:00 devstack sudo[97581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc031608-d602-4ec5-94fb-8768eafaf0c2
Jul 04 00:01:00 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:00 devstack sudo[97583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:01:00 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:01 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc031608-d602-4ec5-94fb-8768eafaf0c2" returned: 0 in 1.062s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Lock "cinder-quobyte-bc031608-d602-4ec5-94fb-8768eafaf0c2" released by "delete_volume" :: held 2.618s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Created reservations ['fbd0b22b-9ddd-41f6-8b3c-56be9d62ee84', 'bc529d74-59ad-46d9-8fce-da401f3c0b2f', 'da00f4ac-b99a-420b-be36-03c4bc01b0fd', 'ce4aedbe-039d-4a9c-90b7-4ac31f2fb11f'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Flow 'volume_create_manager' (6b3c0c8a-b1dd-4b84-bdce-480827b30c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f244795-dc31-49ca-995e-830fbb407b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f244795-dc31-49ca-995e-830fbb407b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1503708037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318870a7-15c9-480c-8aa8-73e7a9884e42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47ca2f6a66d442196bb68ecbd06dd0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:02Z,use_quota=True,user_id='33afdb65f6bc465e8c66bb01348c74b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3efcb8-079b-424e-aa33-5323d9416199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3efcb8-079b-424e-aa33-5323d9416199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f396c95e-e747-46eb-ab3a-359825690f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f396c95e-e747-46eb-ab3a-359825690f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '318870a7-15c9-480c-8aa8-73e7a9884e42', 'volume_name': 'volume-318870a7-15c9-480c-8aa8-73e7a9884e42', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:01 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4dae007-2fda-48af-8273-15750ae11f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4dae007-2fda-48af-8273-15750ae11f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22ef200-f29b-42eb-b8ce-34dace25d39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:01 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Volume 318870a7-15c9-480c-8aa8-73e7a9884e42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-318870a7-15c9-480c-8aa8-73e7a9884e42', 'volume_size': 1}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1503708037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=318870a7-15c9-480c-8aa8-73e7a9884e42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47ca2f6a66d442196bb68ecbd06dd0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:02Z,use_quota=True,user_id='33afdb65f6bc465e8c66bb01348c74b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Creating volume 318870a7-15c9-480c-8aa8-73e7a9884e42 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:01 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.348s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:01 devstack sudo[97587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42 1073741824
Jul 04 00:01:01 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Deleted volume successfully.
Jul 04 00:01:01 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bd7e7575-89a0-455b-b15a-fd1e9ec2d4b2 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-7abdcc6e-c127-4aea-94f0-8f58ab5adc6a-delete_volume" released by "delete_volume" :: held 18.153s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:02 devstack sudo[97589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:01:02 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "cinder-c05bd648-75a7-45f2-969c-ab743b9f489b-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Lock "cinder-c05bd648-75a7-45f2-969c-ab743b9f489b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "cinder-quobyte-c05bd648-75a7-45f2-969c-ab743b9f489b" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Lock "cinder-quobyte-c05bd648-75a7-45f2-969c-ab743b9f489b" acquired by "delete_volume" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:02 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9304854-0eeb-42f6-b382-94f9c0f169cc]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c05bd648-75a7-45f2-969c-ab743b9f489b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:02 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.879s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:02 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:02 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Deleted volume successfully.
Jul 04 00:01:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ab19f4e6-de5d-4fe2-9b12-555e538b286d tempest-AttachVolumeNegativeTest-608528329 None] Lock "cinder-bc031608-d602-4ec5-94fb-8768eafaf0c2-delete_volume" released by "delete_volume" :: held 4.071s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:02 devstack sudo[97596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c05bd648-75a7-45f2-969c-ab743b9f489b
Jul 04 00:01:02 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:03 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42 1073741824" returned: 0 in 1.158s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:03 devstack sudo[97599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42
Jul 04 00:01:03 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:03 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c05bd648-75a7-45f2-969c-ab743b9f489b" returned: 0 in 0.901s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c05bd648-75a7-45f2-969c-ab743b9f489b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:03 devstack sudo[97605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c05bd648-75a7-45f2-969c-ab743b9f489b
Jul 04 00:01:03 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:03 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42" returned: 0 in 0.878s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:03 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] <== create_volume: return (2090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22ef200-f29b-42eb-b8ce-34dace25d39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-318870a7-15c9-480c-8aa8-73e7a9884e42', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971b9ba2-ce32-41cb-9790-1efbb64d5292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:04 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Volume volume-318870a7-15c9-480c-8aa8-73e7a9884e42 (318870a7-15c9-480c-8aa8-73e7a9884e42): created successfully
Jul 04 00:01:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (971b9ba2-ce32-41cb-9790-1efbb64d5292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Flow 'volume_create_manager' (6b3c0c8a-b1dd-4b84-bdce-480827b30c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:04 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-74e66fdd-f505-4676-80da-734d11dd0899 tempest-VolumesDeleteCascade-1215698771 None] Created volume successfully.
Jul 04 00:01:04 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c05bd648-75a7-45f2-969c-ab743b9f489b" returned: 0 in 0.867s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Lock "cinder-quobyte-c05bd648-75a7-45f2-969c-ab743b9f489b" released by "delete_volume" :: held 1.822s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:04 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Created reservations ['8f6a9024-08d8-49dc-be22-4396fab64c70', '96bd3a80-7e3a-432e-9b59-a62799d9606c', '769e2d13-02e7-4769-93aa-d8569a3f7418', '34fdfce2-de1f-4429-a867-ecc85cab1078'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:04 devstack sudo[97609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:01:04 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] Creating offline snapshot 61759fa0-43e2-41ae-848c-d5da7fd2a07f of volume 318870a7-15c9-480c-8aa8-73e7a9884e42 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:01:05 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1e560c-0972-49ca-ad30-8da836606ef0]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:05 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.886s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:05 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:05 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Deleted volume successfully.
Jul 04 00:01:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bffd7506-a965-4677-9d12-5afabddc04a3 tempest-AttachVolumeNegativeTest-608528329 None] Lock "cinder-c05bd648-75a7-45f2-969c-ab743b9f489b-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:05 devstack sudo[97613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42
Jul 04 00:01:05 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:06 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42" returned: 0 in 0.881s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:06 devstack sudo[97619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f 1G
Jul 04 00:01:06 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f 1G" returned: 0 in 1.062s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-318870a7-15c9-480c-8aa8-73e7a9884e42 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:07 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:07 devstack sudo[97626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-318870a7-15c9-480c-8aa8-73e7a9884e42 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f
Jul 04 00:01:07 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:08 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-318870a7-15c9-480c-8aa8-73e7a9884e42 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f" returned: 0 in 0.829s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:08 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f is being set with open permissions: ugo+rw
Jul 04 00:01:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:08 devstack sudo[97632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f
Jul 04 00:01:08 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:09 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f" returned: 0 in 1.123s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:09 devstack sudo[97637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.info
Jul 04 00:01:09 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:10 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.info" returned: 0 in 0.859s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:10 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.info is being set with open permissions: ugo+rw
Jul 04 00:01:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:10 devstack sudo[97642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.info
Jul 04 00:01:10 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:11 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.info" returned: 0 in 0.882s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.755s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:11 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-907eef5c-dfeb-4f6a-add1-4494b230c1f4 tempest-VolumesDeleteCascade-1215698771 None] Create snapshot completed successfully
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Flow 'volume_create_manager' (f94b8ac6-66a7-4afa-b39a-6bb094ef4100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bedcba5-7275-471e-9368-e00282e769c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bedcba5-7275-471e-9368-e00282e769c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-346894992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2010fe1a-b52d-4a45-819a-e43393041207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b47ca2f6a66d442196bb68ecbd06dd0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=61759fa0-43e2-41ae-848c-d5da7fd2a07f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:13Z,use_quota=True,user_id='33afdb65f6bc465e8c66bb01348c74b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a402f70-0e6b-4605-a493-600a29672697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a402f70-0e6b-4605-a493-600a29672697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bb32b6-c714-4fa3-af63-5025e18f894a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bb32b6-c714-4fa3-af63-5025e18f894a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2010fe1a-b52d-4a45-819a-e43393041207', 'volume_name': 'volume-2010fe1a-b52d-4a45-819a-e43393041207', 'volume_size': 1, 'snapshot_id': '61759fa0-43e2-41ae-848c-d5da7fd2a07f'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9807eee5-a4c5-4a2f-8f3d-722f99474d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9807eee5-a4c5-4a2f-8f3d-722f99474d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ed8261-1ae8-4ec0-a8ae-3a459247dc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:12 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Volume 2010fe1a-b52d-4a45-819a-e43393041207: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2010fe1a-b52d-4a45-819a-e43393041207', 'volume_size': 1, 'snapshot_id': '61759fa0-43e2-41ae-848c-d5da7fd2a07f'}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-quobyte-61759fa0-43e2-41ae-848c-d5da7fd2a07f-2010fe1a-b52d-4a45-819a-e43393041207" by "_create_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-61759fa0-43e2-41ae-848c-d5da7fd2a07f-2010fe1a-b52d-4a45-819a-e43393041207" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Creating volume 2010fe1a-b52d-4a45-819a-e43393041207 from snapshot 61759fa0-43e2-41ae-848c-d5da7fd2a07f {{(pid=86650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-quobyte-2010fe1a-b52d-4a45-819a-e43393041207" by "_copy_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-2010fe1a-b52d-4a45-819a-e43393041207" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] snapshot: 61759fa0-43e2-41ae-848c-d5da7fd2a07f, volume: 2010fe1a-b52d-4a45-819a-e43393041207,  {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dff3c91-2c70-4328-8e83-3237d95c3520]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:12 devstack sudo[97645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f
Jul 04 00:01:12 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:13 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f" returned: 0 in 0.906s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-318870a7-15c9-480c-8aa8-73e7a9884e42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:01:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] will copy from snapshot at /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42 {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:01:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Creating direct copy from snapshot {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:01:13 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de89f91-5025-45da-954a-8a25058bcc9f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:13 devstack sudo[97651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42
Jul 04 00:01:13 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:01:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:14 devstack sudo[97655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:01:14 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:14 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42" returned: 0 in 0.900s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:14 devstack cinder-volume[86650]: DEBUG cinder.utils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Path /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2010fe1a-b52d-4a45-819a-e43393041207 not found in is_blk_device check {{(pid=86650) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:01:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2010fe1a-b52d-4a45-819a-e43393041207 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:14 devstack sudo[97658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2010fe1a-b52d-4a45-819a-e43393041207
Jul 04 00:01:14 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:15 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.055s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:01:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 28 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:01:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:01:20 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2010fe1a-b52d-4a45-819a-e43393041207" returned: 0 in 5.781s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:20 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[558dfa76-4863-4844-8447-dc98f3b40a92]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:20 devstack sudo[97673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42
Jul 04 00:01:20 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:21 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42" returned: 0 in 1.045s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:21 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Image conversion details: src /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2010fe1a-b52d-4a45-819a-e43393041207 {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:01:21 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Converted 1024.00 MB image at 177.10 MB/s
Jul 04 00:01:21 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2010fe1a-b52d-4a45-819a-e43393041207 is being set with open permissions: ugo+rw
Jul 04 00:01:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2010fe1a-b52d-4a45-819a-e43393041207 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:21 devstack sudo[97678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2010fe1a-b52d-4a45-819a-e43393041207
Jul 04 00:01:21 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Flow 'volume_create_manager' (36d5f6a6-44da-4485-ac7f-6a3b072c3e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c56cce-a5ef-419d-816b-90841ac44c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:22 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2010fe1a-b52d-4a45-819a-e43393041207" returned: 0 in 0.782s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-2010fe1a-b52d-4a45-819a-e43393041207" released by "_copy_volume_from_snapshot" :: held 9.544s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c56cce-a5ef-419d-816b-90841ac44c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e508aebb-ddbf-41ae-b5df-ca8779114e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71de421003fb40fc9e7f1a2c9de75c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:22Z,use_quota=True,user_id='0c8e6b6519ed47f8abf635359416ddfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86297a29-78ac-4b08-88b9-b47d8e0bab7a),volume_type_id=86297a29-78ac-4b08-88b9-b47d8e0bab7a)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae84ab66-afbb-426e-bfbb-446149bbf13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae84ab66-afbb-426e-bfbb-446149bbf13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9672930a-0c0c-4f1e-be72-93e568079fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.image.glance [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Creating Keystone auth plugin from conf {{(pid=86650) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-61759fa0-43e2-41ae-848c-d5da7fd2a07f-2010fe1a-b52d-4a45-819a-e43393041207" released by "_create_volume_from_snapshot" :: held 9.624s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.645s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63ed8261-1ae8-4ec0-a8ae-3a459247dc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2010fe1a-b52d-4a45-819a-e43393041207', 'volume_size': 1, 'snapshot_id': '61759fa0-43e2-41ae-848c-d5da7fd2a07f'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6a1e2e-2eb9-4cf7-8209-165dae265239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:22 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Volume volume-2010fe1a-b52d-4a45-819a-e43393041207 (2010fe1a-b52d-4a45-819a-e43393041207): created successfully
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6a1e2e-2eb9-4cf7-8209-165dae265239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Flow 'volume_create_manager' (f94b8ac6-66a7-4afa-b39a-6bb094ef4100) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:22 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e1ba18c0-ad38-44e0-b732-6cd43588006a tempest-VolumesDeleteCascade-1215698771 None] Created volume successfully.
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-318870a7-15c9-480c-8aa8-73e7a9884e42-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-318870a7-15c9-480c-8aa8-73e7a9884e42-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Performing cascade delete. {{(pid=86650) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-61759fa0-43e2-41ae-848c-d5da7fd2a07f-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-61759fa0-43e2-41ae-848c-d5da7fd2a07f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9672930a-0c0c-4f1e-be72-93e568079fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e508aebb-ddbf-41ae-b5df-ca8779114e6e', 'volume_name': 'volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e', 'volume_size': 1, 'image_id': 'edde3f38-b3ac-4b75-9030-6e91d763df3f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edde3f38-b3ac-4b75-9030-6e91d763df3f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2d12bf317e4b2f733b511b32342ef77e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '71de421003fb40fc9e7f1a2c9de75c6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3154768feec95c295d11a027ab68ddc2ced1ee0c0238cc3eb056d9b08b97c84849a7275aa4f85e69c3edc2518504bc5226804773032aed4f24d897934b1768a', 'id': 'edde3f38-b3ac-4b75-9030-6e91d763df3f', 'created_at': datetime.datetime(2026, 7, 3, 22, 1, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 1, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edde3f38-b3ac-4b75-9030-6e91d763df3f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000cd9520>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672253bc-3a4f-4f1a-907d-a069d5c2a71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672253bc-3a4f-4f1a-907d-a069d5c2a71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea6a65a-8b60-400a-9318-ad156581cbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:22 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Volume e508aebb-ddbf-41ae-b5df-ca8779114e6e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e', 'volume_size': 1, 'image_id': 'edde3f38-b3ac-4b75-9030-6e91d763df3f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edde3f38-b3ac-4b75-9030-6e91d763df3f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2d12bf317e4b2f733b511b32342ef77e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '71de421003fb40fc9e7f1a2c9de75c6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3154768feec95c295d11a027ab68ddc2ced1ee0c0238cc3eb056d9b08b97c84849a7275aa4f85e69c3edc2518504bc5226804773032aed4f24d897934b1768a', 'id': 'edde3f38-b3ac-4b75-9030-6e91d763df3f', 'created_at': datetime.datetime(2026, 7, 3, 22, 1, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 1, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edde3f38-b3ac-4b75-9030-6e91d763df3f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000cd9520>}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Trying to clone e508aebb-ddbf-41ae-b5df-ca8779114e6e from image edde3f38-b3ac-4b75-9030-6e91d763df3f at location (None, [{'url': 'file:///opt/stack/data/glance/images/edde3f38-b3ac-4b75-9030-6e91d763df3f', 'metadata': {}}]). {{(pid=86650) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-quobyte-318870a7-15c9-480c-8aa8-73e7a9884e42" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-318870a7-15c9-480c-8aa8-73e7a9884e42" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-quobyte-61759fa0-43e2-41ae-848c-d5da7fd2a07f" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-61759fa0-43e2-41ae-848c-d5da7fd2a07f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Deleting offline snapshot 61759fa0-43e2-41ae-848c-d5da7fd2a07f of volume 318870a7-15c9-480c-8aa8-73e7a9884e42 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] snapshot_file for this snap is: volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a95543f-1355-48ac-9665-55f95fcf810b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:22 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 04 00:01:22 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Image download 0.00 MB at 0.00 MB/s
Jul 04 00:01:23 devstack sudo[97681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f
Jul 04 00:01:23 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bfda89-af81-492f-8b81-40d690f6ed8f]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:23 devstack sudo[97683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD
Jul 04 00:01:23 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Flow 'volume_create_manager' (d4cd6ee0-6008-4489-93a1-ea8a39f29478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf5665f-58dd-4996-8c56-6c09a8e25654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcf5665f-58dd-4996-8c56-6c09a8e25654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-680583010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee36af36-b979-49af-ba8c-33f243c2d18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c44133510ca43f5a1e6ae1ab0a8fdc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:23Z,use_quota=True,user_id='6d23c3a70fd64e8a932c429289f3b0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0dbf44e-fa2a-4109-a3dc-38de0850b0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0dbf44e-fa2a-4109-a3dc-38de0850b0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c692e6f-2bec-48b2-bc6c-7f0b65ed2985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c692e6f-2bec-48b2-bc6c-7f0b65ed2985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee36af36-b979-49af-ba8c-33f243c2d18d', 'volume_name': 'volume-ee36af36-b979-49af-ba8c-33f243c2d18d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6d548f-a6be-4351-a752-b7bfe170371f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6d548f-a6be-4351-a752-b7bfe170371f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb9dbda-e1d1-4554-8c02-648a8ad83ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:23 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Volume ee36af36-b979-49af-ba8c-33f243c2d18d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee36af36-b979-49af-ba8c-33f243c2d18d', 'volume_size': 1}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-680583010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee36af36-b979-49af-ba8c-33f243c2d18d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c44133510ca43f5a1e6ae1ab0a8fdc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:23Z,use_quota=True,user_id='6d23c3a70fd64e8a932c429289f3b0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Creating volume ee36af36-b979-49af-ba8c-33f243c2d18d {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:23 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:23 devstack sudo[97686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d 1073741824
Jul 04 00:01:23 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:23 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f" returned: 0 in 0.816s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-318870a7-15c9-480c-8aa8-73e7a9884e42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a799d4-fccd-4f09-9785-68e48e73e200]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:23 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:23 devstack sudo[97693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42
Jul 04 00:01:23 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:23 devstack sudo[97694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD
Jul 04 00:01:23 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:24 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d 1073741824" returned: 0 in 0.928s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:24 devstack sudo[97700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d
Jul 04 00:01:24 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:24 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42" returned: 0 in 0.809s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:24 devstack sudo[97705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f
Jul 04 00:01:24 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:24 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD" returned: 1 in 0.842s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:01:24 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Temporary image edde3f38-b3ac-4b75-9030-6e91d763df3f is fetched for user 0c8e6b6519ed47f8abf635359416ddfe. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 04 00:01:24 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e79c96-d5be-41c8-9f11-c48e572d7e08]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:24 devstack sudo[97710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD
Jul 04 00:01:24 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:25 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d" returned: 0 in 0.707s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb9dbda-e1d1-4554-8c02-648a8ad83ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee36af36-b979-49af-ba8c-33f243c2d18d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3285ca-cdbf-499d-ab84-d470034fe300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:25 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Volume volume-ee36af36-b979-49af-ba8c-33f243c2d18d (ee36af36-b979-49af-ba8c-33f243c2d18d): created successfully
Jul 04 00:01:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a3285ca-cdbf-499d-ab84-d470034fe300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Flow 'volume_create_manager' (d4cd6ee0-6008-4489-93a1-ea8a39f29478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:25 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3da8de79-e605-4390-81c0-2166ff64c855 tempest-SnapshotsActionsTest-1770141133 None] Created volume successfully.
Jul 04 00:01:25 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f" returned: 0 in 0.887s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:25 devstack sudo[97720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f
Jul 04 00:01:25 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:25 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD" returned: 0 in 0.811s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] Creating offline snapshot 1943bc5a-fab2-4bd0-a635-3477360dcf5a of volume ee36af36-b979-49af-ba8c-33f243c2d18d {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:01:25 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7630143f-0579-4864-9670-d464179d7366]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:25 devstack sudo[97722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD
Jul 04 00:01:25 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:25 devstack sudo[97723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d
Jul 04 00:01:25 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:26 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42.61759fa0-43e2-41ae-848c-d5da7fd2a07f" returned: 0 in 0.732s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-61759fa0-43e2-41ae-848c-d5da7fd2a07f" released by "_delete_snapshot" :: held 3.346s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-318870a7-15c9-480c-8aa8-73e7a9884e42" released by "delete_snapshot" :: held 3.372s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:26 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Created reservations ['6d69dc7f-6666-4013-abf1-5fe48552c224', '072b45af-ebb5-42ef-ab7f-65b4d65deed4', 'a30c9f69-90a2-4fa8-8b7e-50fd9aa8fdb9', '55d03dc7-b0bf-474e-bf64-8fcff4b846cf'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:26 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Delete snapshot completed successfully.
Jul 04 00:01:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-61759fa0-43e2-41ae-848c-d5da7fd2a07f-delete_snapshot" released by "delete_snapshot" :: held 3.585s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Snapshots deleted, issuing volume delete {{(pid=86650) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 04 00:01:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-quobyte-318870a7-15c9-480c-8aa8-73e7a9884e42" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:26 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD" returned: 1 in 0.821s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:01:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-318870a7-15c9-480c-8aa8-73e7a9884e42" acquired by "delete_volume" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:26 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfccaad-e008-456d-8a97-5f5e02a74f6b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:26 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d" returned: 0 in 0.850s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:26 devstack sudo[97736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a 1G
Jul 04 00:01:26 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:26 devstack sudo[97734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42
Jul 04 00:01:26 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:27 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42" returned: 0 in 0.793s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:27 devstack sudo[97746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42
Jul 04 00:01:27 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:27 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a 1G" returned: 0 in 0.846s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee36af36-b979-49af-ba8c-33f243c2d18d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:27 devstack sudo[97748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee36af36-b979-49af-ba8c-33f243c2d18d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a
Jul 04 00:01:27 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:27 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-318870a7-15c9-480c-8aa8-73e7a9884e42" returned: 0 in 0.676s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-318870a7-15c9-480c-8aa8-73e7a9884e42" released by "delete_volume" :: held 1.538s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Created reservations ['a7045fbf-ed6a-4aff-a505-845eaa3c153c', 'e537bc5b-8cc5-438b-b743-23d0be196953', 'dc4534c0-f928-4860-bb7a-b9748653f193', '4a532ed7-462a-4825-b434-f2a674c282c1'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:28 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee36af36-b979-49af-ba8c-33f243c2d18d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a" returned: 0 in 0.693s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:28 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a is being set with open permissions: ugo+rw
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:28 devstack sudo[97754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a
Jul 04 00:01:28 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:28 devstack sudo[97756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:01:28 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-2010fe1a-b52d-4a45-819a-e43393041207-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-2010fe1a-b52d-4a45-819a-e43393041207-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "cinder-quobyte-2010fe1a-b52d-4a45-819a-e43393041207" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-2010fe1a-b52d-4a45-819a-e43393041207" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[be841eb1-82af-49fc-b52d-68c75e6a8c9b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2010fe1a-b52d-4a45-819a-e43393041207 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:28 devstack sudo[97758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2010fe1a-b52d-4a45-819a-e43393041207
Jul 04 00:01:28 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:28 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a" returned: 0 in 0.688s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:28 devstack sudo[97762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.info
Jul 04 00:01:28 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:28 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.780s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:28 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Deleted volume successfully.
Jul 04 00:01:28 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-712aecd9-11e6-48a6-a9da-ffc61cb3366e tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-318870a7-15c9-480c-8aa8-73e7a9884e42-delete_volume" released by "delete_volume" :: held 6.188s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:29 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2010fe1a-b52d-4a45-819a-e43393041207" returned: 0 in 0.879s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2010fe1a-b52d-4a45-819a-e43393041207 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:29 devstack sudo[97767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2010fe1a-b52d-4a45-819a-e43393041207
Jul 04 00:01:29 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:29 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.info" returned: 0 in 0.712s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:29 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.info is being set with open permissions: ugo+rw
Jul 04 00:01:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:29 devstack sudo[97770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.info
Jul 04 00:01:29 devstack sudo[97770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:30 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2010fe1a-b52d-4a45-819a-e43393041207" returned: 0 in 0.705s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-quobyte-2010fe1a-b52d-4a45-819a-e43393041207" released by "delete_volume" :: held 1.635s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Created reservations ['3dfbee53-3a8a-45b3-8862-282231127369', '883a80f0-305b-4d23-9ecd-04fd2ed5e570', '1e3405f3-de16-4edf-9bd1-961e6f37cc8f', '1f2ed516-ee3a-4186-99b3-b9e02ea1c296'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:30 devstack sudo[97770]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.info" returned: 0 in 0.727s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.615s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:30 devstack sudo[97774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:01:30 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.827s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e508aebb-ddbf-41ae-b5df-ca8779114e6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71de421003fb40fc9e7f1a2c9de75c6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:22Z,use_quota=True,user_id='0c8e6b6519ed47f8abf635359416ddfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86297a29-78ac-4b08-88b9-b47d8e0bab7a),volume_type_id=86297a29-78ac-4b08-88b9-b47d8e0bab7a)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Creating volume e508aebb-ddbf-41ae-b5df-ca8779114e6e {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:30 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:30 devstack sudo[97776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e 1073741824
Jul 04 00:01:30 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:30 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-b183f696-705b-4af4-9cad-216a0a155dd9 tempest-SnapshotsActionsTest-1770141133 None] Create snapshot completed successfully
Jul 04 00:01:30 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.753s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:30 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Deleted volume successfully.
Jul 04 00:01:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15939aa7-fb2b-4ff3-a339-be827643d842 tempest-VolumesDeleteCascade-1215698771 None] Lock "cinder-2010fe1a-b52d-4a45-819a-e43393041207-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:31 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e 1073741824" returned: 0 in 1.105s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1af56f9c-ac77-43b7-b83a-0a8c2cf750c3 tempest-SnapshotsActionsTest-1770141133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:31 devstack sudo[97783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e
Jul 04 00:01:31 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e" returned: 0 in 0.735s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:32 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1af56f9c-ac77-43b7-b83a-0a8c2cf750c3 tempest-SnapshotsActionsTest-1770141133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.750s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:32 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:32 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-1af56f9c-ac77-43b7-b83a-0a8c2cf750c3 tempest-SnapshotsActionsTest-1770141133 None] Creating offline snapshot 497a2a39-fe3d-432f-9a45-059aa73f92b7 of volume ee36af36-b979-49af-ba8c-33f243c2d18d {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:01:32 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e13fc71-4df3-403b-b368-bda1b4745f01]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1af56f9c-ac77-43b7-b83a-0a8c2cf750c3 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:32 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Attempting download of edde3f38-b3ac-4b75-9030-6e91d763df3f ((None, [{'url': 'file:///opt/stack/data/glance/images/edde3f38-b3ac-4b75-9030-6e91d763df3f', 'metadata': {}}])) to volume e508aebb-ddbf-41ae-b5df-ca8779114e6e. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 04 00:01:32 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fa6072-d603-4585-8b83-f277c19eac17]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edde3f38-b3ac-4b75-9030-6e91d763df3f_hhekadzs {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:32 devstack sudo[97788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a
Jul 04 00:01:32 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:32 devstack sudo[97789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edde3f38-b3ac-4b75-9030-6e91d763df3f_hhekadzs
Jul 04 00:01:32 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:33 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1af56f9c-ac77-43b7-b83a-0a8c2cf750c3 tempest-SnapshotsActionsTest-1770141133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a" returned: 0 in 0.935s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-1af56f9c-ac77-43b7-b83a-0a8c2cf750c3 tempest-SnapshotsActionsTest-1770141133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee36af36-b979-49af-ba8c-33f243c2d18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:01:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1af56f9c-ac77-43b7-b83a-0a8c2cf750c3 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:33 devstack sudo[97797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7 1G
Jul 04 00:01:33 devstack sudo[97797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:33 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edde3f38-b3ac-4b75-9030-6e91d763df3f_hhekadzs" returned: 0 in 0.846s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edde3f38-b3ac-4b75-9030-6e91d763df3f_hhekadzs {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:33 devstack sudo[97799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edde3f38-b3ac-4b75-9030-6e91d763df3f_hhekadzs
Jul 04 00:01:33 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:34 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edde3f38-b3ac-4b75-9030-6e91d763df3f_hhekadzs" returned: 1 in 0.860s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edde3f38-b3ac-4b75-9030-6e91d763df3f_hhekadzs' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[913410c6-c838-4bf7-b764-4e1ec33cfc0a]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Flow 'volume_create_manager' (191c35cb-d358-467b-83c5-caebfb5068ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2cba7b6-ca12-469b-b1cf-facca14a72fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2cba7b6-ca12-469b-b1cf-facca14a72fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1545917882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f4cbc7-171b-4a8b-9923-d1678017e002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a96e080377e47398bc255a4c1e22753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:34Z,use_quota=True,user_id='016e79e086784cac9105766afdb488cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54aaacb-d8fd-415f-89a3-62cb8443c0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54aaacb-d8fd-415f-89a3-62cb8443c0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00efe44-5a2e-4701-af5f-f8b7e4191227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:34 devstack sudo[97797]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00efe44-5a2e-4701-af5f-f8b7e4191227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00f4cbc7-171b-4a8b-9923-d1678017e002', 'volume_name': 'volume-00f4cbc7-171b-4a8b-9923-d1678017e002', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ef1d1f-2977-48cd-b05c-74c452898b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ef1d1f-2977-48cd-b05c-74c452898b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:34 devstack sudo[97808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD
Jul 04 00:01:34 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea541812-7b05-43f8-86d3-290d14ea7885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:34 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Volume 00f4cbc7-171b-4a8b-9923-d1678017e002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00f4cbc7-171b-4a8b-9923-d1678017e002', 'volume_size': 1}
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1af56f9c-ac77-43b7-b83a-0a8c2cf750c3 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7 1G" returned: 0 in 1.014s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1af56f9c-ac77-43b7-b83a-0a8c2cf750c3 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:34 devstack sudo[97810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7
Jul 04 00:01:34 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:34 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD" returned: 0 in 0.762s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:34 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1af56f9c-ac77-43b7-b83a-0a8c2cf750c3 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7" returned: 0 in 0.722s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:34 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-1af56f9c-ac77-43b7-b83a-0a8c2cf750c3 tempest-SnapshotsActionsTest-1770141133 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7 is being set with open permissions: ugo+rw
Jul 04 00:01:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1af56f9c-ac77-43b7-b83a-0a8c2cf750c3 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:34 devstack sudo[97818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7
Jul 04 00:01:34 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:34 devstack sudo[97817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD
Jul 04 00:01:34 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:35 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD" returned: 1 in 0.753s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:01:35 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] edde3f38-b3ac-4b75-9030-6e91d763df3f was raw, converting to raw {{(pid=86650) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 04 00:01:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:35 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1af56f9c-ac77-43b7-b83a-0a8c2cf750c3 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7" returned: 0 in 0.694s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:35 devstack sudo[97826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e
Jul 04 00:01:35 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1af56f9c-ac77-43b7-b83a-0a8c2cf750c3 tempest-SnapshotsActionsTest-1770141133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.528s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.458s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1545917882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00f4cbc7-171b-4a8b-9923-d1678017e002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a96e080377e47398bc255a4c1e22753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:34Z,use_quota=True,user_id='016e79e086784cac9105766afdb488cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Creating volume 00f4cbc7-171b-4a8b-9923-d1678017e002 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:35 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:01:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00f4cbc7-171b-4a8b-9923-d1678017e002 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:35 devstack sudo[97828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00f4cbc7-171b-4a8b-9923-d1678017e002 1073741824
Jul 04 00:01:35 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:35 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-1af56f9c-ac77-43b7-b83a-0a8c2cf750c3 tempest-SnapshotsActionsTest-1770141133 None] Create snapshot completed successfully
Jul 04 00:01:36 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e" returned: 0 in 0.776s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:36 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_edde3f38-b3ac-4b75-9030-6e91d763df3f_q_7mnpizdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:01:36 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Converted 0.00 MB image at 0.00 MB/s
Jul 04 00:01:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:36 devstack sudo[97837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e 1G
Jul 04 00:01:36 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:36 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00f4cbc7-171b-4a8b-9923-d1678017e002 1073741824" returned: 0 in 0.949s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00f4cbc7-171b-4a8b-9923-d1678017e002 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:36 devstack sudo[97839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00f4cbc7-171b-4a8b-9923-d1678017e002
Jul 04 00:01:36 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Acquiring lock "cinder-497a2a39-fe3d-432f-9a45-059aa73f92b7-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-497a2a39-fe3d-432f-9a45-059aa73f92b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Acquiring lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Acquiring lock "cinder-quobyte-497a2a39-fe3d-432f-9a45-059aa73f92b7" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-quobyte-497a2a39-fe3d-432f-9a45-059aa73f92b7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Deleting offline snapshot 497a2a39-fe3d-432f-9a45-059aa73f92b7 of volume ee36af36-b979-49af-ba8c-33f243c2d18d {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:01:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] snapshot_file for this snap is: volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:01:36 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef22ff6b-ef7f-4aea-8bf7-5ad6bc004bd5]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:36 devstack sudo[97841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7
Jul 04 00:01:36 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:37 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e 1G" returned: 0 in 0.821s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:37 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[012c01cf-b0ec-45dd-8afe-221e32f1d1c0]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:37 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00f4cbc7-171b-4a8b-9923-d1678017e002" returned: 0 in 0.675s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:37 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea541812-7b05-43f8-86d3-290d14ea7885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00f4cbc7-171b-4a8b-9923-d1678017e002', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da4180a-2ea9-4440-9e49-2f8983ad66f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:37 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Volume volume-00f4cbc7-171b-4a8b-9923-d1678017e002 (00f4cbc7-171b-4a8b-9923-d1678017e002): created successfully
Jul 04 00:01:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da4180a-2ea9-4440-9e49-2f8983ad66f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:37 devstack sudo[97847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e
Jul 04 00:01:37 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Flow 'volume_create_manager' (191c35cb-d358-467b-83c5-caebfb5068ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:37 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-1477db30-69c9-483e-b1cb-31dace211fca tempest-VolumesMetadataTest-1670038937 None] Created volume successfully.
Jul 04 00:01:37 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7" returned: 0 in 0.905s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:37 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee36af36-b979-49af-ba8c-33f243c2d18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:01:37 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2966ba-ffd2-4324-b7bd-5b946f9471ee]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:37 devstack sudo[97852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a
Jul 04 00:01:37 devstack sudo[97852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:38 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e" returned: 0 in 0.766s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:38 devstack sudo[97856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e
Jul 04 00:01:38 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:38 devstack sudo[97852]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a" returned: 0 in 0.861s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee36af36-b979-49af-ba8c-33f243c2d18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:01:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:38 devstack sudo[97863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7
Jul 04 00:01:38 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:38 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e" returned: 1 in 0.822s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:01:38 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Downloaded image edde3f38-b3ac-4b75-9030-6e91d763df3f ((None, [{'url': 'file:///opt/stack/data/glance/images/edde3f38-b3ac-4b75-9030-6e91d763df3f', 'metadata': {}}])) to volume e508aebb-ddbf-41ae-b5df-ca8779114e6e successfully. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 04 00:01:38 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Temporary image edde3f38-b3ac-4b75-9030-6e91d763df3f for user 0c8e6b6519ed47f8abf635359416ddfe is deleted. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 04 00:01:38 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Marking volume e508aebb-ddbf-41ae-b5df-ca8779114e6e as bootable. {{(pid=86650) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 04 00:01:38 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Copying metadata from image edde3f38-b3ac-4b75-9030-6e91d763df3f to e508aebb-ddbf-41ae-b5df-ca8779114e6e. {{(pid=86650) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 04 00:01:38 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Creating volume glance metadata for volume e508aebb-ddbf-41ae-b5df-ca8779114e6e backed by image edde3f38-b3ac-4b75-9030-6e91d763df3f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'edde3f38-b3ac-4b75-9030-6e91d763df3f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2d12bf317e4b2f733b511b32342ef77e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86650) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 04 00:01:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea6a65a-8b60-400a-9318-ad156581cbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e', 'volume_size': 1, 'image_id': 'edde3f38-b3ac-4b75-9030-6e91d763df3f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edde3f38-b3ac-4b75-9030-6e91d763df3f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2d12bf317e4b2f733b511b32342ef77e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '71de421003fb40fc9e7f1a2c9de75c6b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f3154768feec95c295d11a027ab68ddc2ced1ee0c0238cc3eb056d9b08b97c84849a7275aa4f85e69c3edc2518504bc5226804773032aed4f24d897934b1768a', 'id': 'edde3f38-b3ac-4b75-9030-6e91d763df3f', 'created_at': datetime.datetime(2026, 7, 3, 22, 1, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 1, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edde3f38-b3ac-4b75-9030-6e91d763df3f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000cd9520>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a42b840-087a-4d11-b55b-1293e2629fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:38 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Volume volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e (e508aebb-ddbf-41ae-b5df-ca8779114e6e): created successfully
Jul 04 00:01:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a42b840-087a-4d11-b55b-1293e2629fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Flow 'volume_create_manager' (36d5f6a6-44da-4485-ac7f-6a3b072c3e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:39 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c791b813-13a5-486c-a083-5fff836b4d98 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Created volume successfully.
Jul 04 00:01:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Acquiring lock "cinder-00f4cbc7-171b-4a8b-9923-d1678017e002-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Lock "cinder-00f4cbc7-171b-4a8b-9923-d1678017e002-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Acquiring lock "cinder-quobyte-00f4cbc7-171b-4a8b-9923-d1678017e002" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Lock "cinder-quobyte-00f4cbc7-171b-4a8b-9923-d1678017e002" acquired by "delete_volume" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:39 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bf3c8a-48cb-49d9-84d9-6a741df2a2c2]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00f4cbc7-171b-4a8b-9923-d1678017e002 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:39 devstack sudo[97871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00f4cbc7-171b-4a8b-9923-d1678017e002
Jul 04 00:01:39 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Acquiring lock "cinder-e508aebb-ddbf-41ae-b5df-ca8779114e6e-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Lock "cinder-e508aebb-ddbf-41ae-b5df-ca8779114e6e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Acquiring lock "cinder-quobyte-e508aebb-ddbf-41ae-b5df-ca8779114e6e" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Lock "cinder-quobyte-e508aebb-ddbf-41ae-b5df-ca8779114e6e" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:39 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7" returned: 0 in 0.891s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:39 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[33be176a-df33-49cd-aabf-00e2d3b0b517]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:39 devstack sudo[97874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7
Jul 04 00:01:39 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:39 devstack sudo[97875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e
Jul 04 00:01:39 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:40 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00f4cbc7-171b-4a8b-9923-d1678017e002" returned: 0 in 0.864s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00f4cbc7-171b-4a8b-9923-d1678017e002 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:40 devstack sudo[97882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00f4cbc7-171b-4a8b-9923-d1678017e002
Jul 04 00:01:40 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:40 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.497a2a39-fe3d-432f-9a45-059aa73f92b7" returned: 0 in 0.692s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-quobyte-497a2a39-fe3d-432f-9a45-059aa73f92b7" released by "_delete_snapshot" :: held 3.454s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" released by "delete_snapshot" :: held 3.486s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Created reservations ['dd14d900-43c6-4128-b8ce-395341c89304', '5c0c83dc-69cd-4565-b93c-ee99db196909', '260c080d-fbfe-4bc0-a6cd-b4985d0e4c24', '642c80c6-4eee-4ccf-9e42-228c3c9642e2'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:40 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e" returned: 0 in 0.808s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:40 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Delete snapshot completed successfully.
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ce5a5ed2-d3e5-4a4d-a46e-4cdd608022c1 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-497a2a39-fe3d-432f-9a45-059aa73f92b7-delete_snapshot" released by "delete_snapshot" :: held 3.657s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:40 devstack sudo[97886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e
Jul 04 00:01:40 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:40 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00f4cbc7-171b-4a8b-9923-d1678017e002" returned: 0 in 0.705s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Lock "cinder-quobyte-00f4cbc7-171b-4a8b-9923-d1678017e002" released by "delete_volume" :: held 1.604s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Created reservations ['de0061c0-cd0a-45d3-aaa3-0b6bb0b15a7c', 'adf5ee91-a49c-457f-9ac8-87ff48158992', 'e35b3ec1-0a44-4438-a155-1105eaeb7eb8', '4de0e9d8-9cdb-4758-848c-71b219cc6a66'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:41 devstack sudo[97889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:01:41 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:41 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e" returned: 1 in 0.847s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:01:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:41 devstack sudo[97894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e
Jul 04 00:01:41 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-38495eaa-7336-4f18-a637-53fbf1712f39 tempest-SnapshotsActionsTest-1770141133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-38495eaa-7336-4f18-a637-53fbf1712f39 tempest-SnapshotsActionsTest-1770141133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:41 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-38495eaa-7336-4f18-a637-53fbf1712f39 tempest-SnapshotsActionsTest-1770141133 None] Creating offline snapshot 87c2512d-0b3f-456c-ac58-5d85fa68f0eb of volume ee36af36-b979-49af-ba8c-33f243c2d18d {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:01:41 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6848ac-5555-4933-80fe-e63707e239be]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-38495eaa-7336-4f18-a637-53fbf1712f39 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:41 devstack sudo[97896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a
Jul 04 00:01:41 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:41 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.822s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:41 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:41 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Deleted volume successfully.
Jul 04 00:01:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ed98887c-50b9-42cd-bd45-beec0ff97e36 tempest-VolumesMetadataTest-1670038937 None] Lock "cinder-00f4cbc7-171b-4a8b-9923-d1678017e002-delete_volume" released by "delete_volume" :: held 2.686s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:42 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e508aebb-ddbf-41ae-b5df-ca8779114e6e" returned: 0 in 0.799s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Lock "cinder-quobyte-e508aebb-ddbf-41ae-b5df-ca8779114e6e" released by "delete_volume" :: held 2.523s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:42 devstack cinder-volume[86650]: WARNING cinder.quota [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:01:42 devstack cinder-volume[86650]: WARNING cinder.quota [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:01:42 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Created reservations ['1bd11e1d-cee8-4d0b-a1d3-e57c42fcd229', '7f23f264-c909-4515-85f5-cec09d6b7e33', '3d69244d-da9d-4fda-a0ba-9c1a9ab8bbe9', 'e783d3ae-1256-44ea-be0a-a1a8ca37ed69'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:42 devstack sudo[97903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:01:42 devstack sudo[97903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:42 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-38495eaa-7336-4f18-a637-53fbf1712f39 tempest-SnapshotsActionsTest-1770141133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a" returned: 0 in 1.005s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-38495eaa-7336-4f18-a637-53fbf1712f39 tempest-SnapshotsActionsTest-1770141133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee36af36-b979-49af-ba8c-33f243c2d18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:01:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-38495eaa-7336-4f18-a637-53fbf1712f39 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:42 devstack sudo[97905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb 1G
Jul 04 00:01:42 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:43 devstack sudo[97903]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.892s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:43 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:43 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Deleted volume successfully.
Jul 04 00:01:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b9aad13d-f6c2-49c7-9f5d-a3a04f8e20e1 tempest-VolumeAndVolumeTypeFromImageTest-372603827 None] Lock "cinder-e508aebb-ddbf-41ae-b5df-ca8779114e6e-delete_volume" released by "delete_volume" :: held 3.718s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:43 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-38495eaa-7336-4f18-a637-53fbf1712f39 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb 1G" returned: 0 in 1.163s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-38495eaa-7336-4f18-a637-53fbf1712f39 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:43 devstack sudo[97913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb
Jul 04 00:01:43 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:44 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-38495eaa-7336-4f18-a637-53fbf1712f39 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb" returned: 0 in 0.839s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:44 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-38495eaa-7336-4f18-a637-53fbf1712f39 tempest-SnapshotsActionsTest-1770141133 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb is being set with open permissions: ugo+rw
Jul 04 00:01:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-38495eaa-7336-4f18-a637-53fbf1712f39 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:44 devstack sudo[97918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb
Jul 04 00:01:44 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:45 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-38495eaa-7336-4f18-a637-53fbf1712f39 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb" returned: 0 in 0.779s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-38495eaa-7336-4f18-a637-53fbf1712f39 tempest-SnapshotsActionsTest-1770141133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.918s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:45 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-38495eaa-7336-4f18-a637-53fbf1712f39 tempest-SnapshotsActionsTest-1770141133 None] Create snapshot completed successfully
Jul 04 00:01:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Acquiring lock "cinder-87c2512d-0b3f-456c-ac58-5d85fa68f0eb-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-87c2512d-0b3f-456c-ac58-5d85fa68f0eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Acquiring lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Acquiring lock "cinder-quobyte-87c2512d-0b3f-456c-ac58-5d85fa68f0eb" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-quobyte-87c2512d-0b3f-456c-ac58-5d85fa68f0eb" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Deleting offline snapshot 87c2512d-0b3f-456c-ac58-5d85fa68f0eb of volume ee36af36-b979-49af-ba8c-33f243c2d18d {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:01:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] snapshot_file for this snap is: volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:01:45 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fb18d5-0e35-4d09-8159-866dd7b63c1e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:46 devstack sudo[97921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb
Jul 04 00:01:46 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:46 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb" returned: 0 in 1.018s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee36af36-b979-49af-ba8c-33f243c2d18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:01:46 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61df247-fa3b-4d42-9537-14151ba69063]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:47 devstack sudo[97926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a
Jul 04 00:01:47 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Flow 'volume_create_manager' (918ea524-f776-4914-a8ed-24e4b4b24861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03211793-7887-4d38-8ab9-9f49b6e7604d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03211793-7887-4d38-8ab9-9f49b6e7604d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-951068538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db24c738-29b5-470d-a7b8-bfc4c398a343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7247653c79554beaa599858c2aeb8a99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:47Z,use_quota=True,user_id='859e5fd1962c43d0a2d98223d94e8142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef461cfd-ee5e-4b25-8142-761c6cceec34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef461cfd-ee5e-4b25-8142-761c6cceec34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554404f5-034c-4e20-9709-772e9e890bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (554404f5-034c-4e20-9709-772e9e890bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db24c738-29b5-470d-a7b8-bfc4c398a343', 'volume_name': 'volume-db24c738-29b5-470d-a7b8-bfc4c398a343', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd31247-feb7-470a-a21a-7a7ff4b903a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fd31247-feb7-470a-a21a-7a7ff4b903a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c86617-6e8b-41a7-bdbc-c41638d1a9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:47 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Volume db24c738-29b5-470d-a7b8-bfc4c398a343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db24c738-29b5-470d-a7b8-bfc4c398a343', 'volume_size': 1}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-951068538',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db24c738-29b5-470d-a7b8-bfc4c398a343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7247653c79554beaa599858c2aeb8a99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:47Z,use_quota=True,user_id='859e5fd1962c43d0a2d98223d94e8142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Creating volume db24c738-29b5-470d-a7b8-bfc4c398a343 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:47 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-db24c738-29b5-470d-a7b8-bfc4c398a343 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:47 devstack sudo[97928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-db24c738-29b5-470d-a7b8-bfc4c398a343 1073741824
Jul 04 00:01:47 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:47 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a" returned: 0 in 0.953s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee36af36-b979-49af-ba8c-33f243c2d18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:01:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:47 devstack sudo[97967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb
Jul 04 00:01:47 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:48 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-db24c738-29b5-470d-a7b8-bfc4c398a343 1073741824" returned: 0 in 1.009s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:48 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Flow 'volume_create_manager' (72bbd244-bdc8-4e74-aae2-84a6c2350a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a28b2fd6-6af1-4aba-9c04-7a91404c994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a28b2fd6-6af1-4aba-9c04-7a91404c994e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1979943784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1815228b-5ce7-44dc-9595-e9584708aebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb99275dc93442fd8b3313ccc09279ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:49Z,use_quota=True,user_id='e2b47b40e6f3494980e431a58216c743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3506630e-9e74-47db-9e19-a533ad1258a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3506630e-9e74-47db-9e19-a533ad1258a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9ff704-7cb2-4392-a287-3a5280f66624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9ff704-7cb2-4392-a287-3a5280f66624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1815228b-5ce7-44dc-9595-e9584708aebc', 'volume_name': 'volume-1815228b-5ce7-44dc-9595-e9584708aebc', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d669535d-30f9-4f55-8ade-909e046000be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d669535d-30f9-4f55-8ade-909e046000be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09dba8ec-83f6-406a-90b5-5073caa8f7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:48 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Volume 1815228b-5ce7-44dc-9595-e9584708aebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1815228b-5ce7-44dc-9595-e9584708aebc', 'volume_size': 1}
Jul 04 00:01:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-db24c738-29b5-470d-a7b8-bfc4c398a343 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:48 devstack sudo[97978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-db24c738-29b5-470d-a7b8-bfc4c398a343
Jul 04 00:01:48 devstack sudo[97978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:48 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb" returned: 0 in 0.931s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:48 devstack sudo[97980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb
Jul 04 00:01:48 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Flow 'volume_create_manager' (77f95121-3b99-4008-9f27-c7982b25c677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbffcdfd-0507-49c9-b996-a8975ebec551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbffcdfd-0507-49c9-b996-a8975ebec551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-209520404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7035ada-e58d-4b63-ae33-9914b5bbce10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb99275dc93442fd8b3313ccc09279ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:49Z,use_quota=True,user_id='e2b47b40e6f3494980e431a58216c743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb251fa-0604-4121-a527-0ac40cef6d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb251fa-0604-4121-a527-0ac40cef6d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e84a67c-55e7-421a-a50a-8dd6bd0c4a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e84a67c-55e7-421a-a50a-8dd6bd0c4a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7035ada-e58d-4b63-ae33-9914b5bbce10', 'volume_name': 'volume-a7035ada-e58d-4b63-ae33-9914b5bbce10', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e520ea-61f1-41be-899b-bb496738f2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e520ea-61f1-41be-899b-bb496738f2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97696153-ccc5-4cd0-aa21-6d567d87ca4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:49 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Volume a7035ada-e58d-4b63-ae33-9914b5bbce10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7035ada-e58d-4b63-ae33-9914b5bbce10', 'volume_size': 1}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:49 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:49 devstack sudo[97978]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.87c2512d-0b3f-456c-ac58-5d85fa68f0eb" returned: 0 in 0.791s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-db24c738-29b5-470d-a7b8-bfc4c398a343" returned: 0 in 0.879s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Flow 'volume_create_manager' (037079aa-2219-4346-b53b-1eee164aed76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334cbe63-9381-4b1d-ade7-2e442d3b17bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.088s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-quobyte-87c2512d-0b3f-456c-ac58-5d85fa68f0eb" released by "_delete_snapshot" :: held 3.859s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.927s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1979943784',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1815228b-5ce7-44dc-9595-e9584708aebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb99275dc93442fd8b3313ccc09279ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:49Z,use_quota=True,user_id='e2b47b40e6f3494980e431a58216c743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Creating volume 1815228b-5ce7-44dc-9595-e9584708aebc {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:49 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1815228b-5ce7-44dc-9595-e9584708aebc 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:49 devstack sudo[97984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1815228b-5ce7-44dc-9595-e9584708aebc 1073741824
Jul 04 00:01:49 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c86617-6e8b-41a7-bdbc-c41638d1a9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db24c738-29b5-470d-a7b8-bfc4c398a343', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f86c09a-8ea6-48ea-ad42-de57907a1514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" released by "delete_snapshot" :: held 3.964s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334cbe63-9381-4b1d-ade7-2e442d3b17bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1901459680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb99275dc93442fd8b3313ccc09279ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:50Z,use_quota=True,user_id='e2b47b40e6f3494980e431a58216c743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf53ffd-4d22-41f9-8c00-2c9ad3a653c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddf53ffd-4d22-41f9-8c00-2c9ad3a653c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea845cab-ab4a-47d4-86d1-02e11be3d245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea845cab-ab4a-47d4-86d1-02e11be3d245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09', 'volume_name': 'volume-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6dc327-1323-456f-ac55-8aa0213e5047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe6dc327-1323-456f-ac55-8aa0213e5047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827c156a-556f-4eed-a218-27173fc65ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:49 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Volume 1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09', 'volume_size': 1}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:49 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Volume volume-db24c738-29b5-470d-a7b8-bfc4c398a343 (db24c738-29b5-470d-a7b8-bfc4c398a343): created successfully
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f86c09a-8ea6-48ea-ad42-de57907a1514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Flow 'volume_create_manager' (918ea524-f776-4914-a8ed-24e4b4b24861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:49 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-0059f4e7-c08c-48fa-8420-a927c9749182 tempest-VolumesTransfersTest-732390950 None] Created volume successfully.
Jul 04 00:01:49 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Created reservations ['9979768e-668f-4f73-8d07-5f8d8082c878', '42a4b010-873c-438c-babe-094e53628cca', '328655cb-7017-4a95-bdd4-139c4a9792ff', 'f92c94a1-fc66-4142-a09e-611f7f21a68f'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:50 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Delete snapshot completed successfully.
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eef8d7b8-618f-4bd0-9fb1-47955aa338c2 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-87c2512d-0b3f-456c-ac58-5d85fa68f0eb-delete_snapshot" released by "delete_snapshot" :: held 4.241s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Flow 'volume_create_manager' (d4f329c9-9b1a-4e64-96fb-01ff6d71cd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5637b95f-aa71-4148-a5a7-df81fe0d5cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5637b95f-aa71-4148-a5a7-df81fe0d5cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1606853189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73648568-1423-4e02-907b-10747a709028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb99275dc93442fd8b3313ccc09279ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:50Z,use_quota=True,user_id='e2b47b40e6f3494980e431a58216c743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4d93e7-aebb-4346-9d3e-d4da1ae99c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a4d93e7-aebb-4346-9d3e-d4da1ae99c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ce9562-1b8a-4fec-9a9c-50875f202ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ce9562-1b8a-4fec-9a9c-50875f202ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73648568-1423-4e02-907b-10747a709028', 'volume_name': 'volume-73648568-1423-4e02-907b-10747a709028', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b8f6e6-b2f8-4b29-a2f8-0f618b6b0bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b8f6e6-b2f8-4b29-a2f8-0f618b6b0bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5580ce-fa51-4e18-9d3d-7c890d526c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:50 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Volume 73648568-1423-4e02-907b-10747a709028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73648568-1423-4e02-907b-10747a709028', 'volume_size': 1}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Flow 'volume_create_manager' (2e80a18b-00ad-44e3-85ec-d1679b5ccac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806873e5-df44-4f79-9c4c-88b272f8fc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (806873e5-df44-4f79-9c4c-88b272f8fc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1842488896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb99275dc93442fd8b3313ccc09279ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:50Z,use_quota=True,user_id='e2b47b40e6f3494980e431a58216c743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (833dbe40-9d0e-4862-8009-e9cd9853315d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (833dbe40-9d0e-4862-8009-e9cd9853315d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873fa3ab-fda5-48c9-a913-99b29e79d389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (873fa3ab-fda5-48c9-a913-99b29e79d389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b', 'volume_name': 'volume-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5286830d-a99a-4aca-ac58-19495f1c534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5286830d-a99a-4aca-ac58-19495f1c534a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbff9b1a-9e40-4509-a919-62bae5f4d6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:50 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Volume 14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b', 'volume_size': 1}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e719ce7c-ab5a-4920-83e7-9e50be50d875 tempest-SnapshotsActionsTest-1770141133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:50 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1815228b-5ce7-44dc-9595-e9584708aebc 1073741824" returned: 0 in 1.058s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1815228b-5ce7-44dc-9595-e9584708aebc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:50 devstack sudo[97990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1815228b-5ce7-44dc-9595-e9584708aebc
Jul 04 00:01:50 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:51 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-cd220835-0388-4b45-9084-bdaab776ec5c tempest-VolumesTransfersTest-287816544 None] Transfer volume completed successfully.
Jul 04 00:01:51 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1815228b-5ce7-44dc-9595-e9584708aebc" returned: 0 in 0.748s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.329s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-209520404',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7035ada-e58d-4b63-ae33-9914b5bbce10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb99275dc93442fd8b3313ccc09279ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:49Z,use_quota=True,user_id='e2b47b40e6f3494980e431a58216c743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Creating volume a7035ada-e58d-4b63-ae33-9914b5bbce10 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:51 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7035ada-e58d-4b63-ae33-9914b5bbce10 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:51 devstack sudo[97993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7035ada-e58d-4b63-ae33-9914b5bbce10 1073741824
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09dba8ec-83f6-406a-90b5-5073caa8f7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1815228b-5ce7-44dc-9595-e9584708aebc', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:51 devstack sudo[97993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa048c3d-4624-4f44-82b3-0db42259cd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:51 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Volume volume-1815228b-5ce7-44dc-9595-e9584708aebc (1815228b-5ce7-44dc-9595-e9584708aebc): created successfully
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa048c3d-4624-4f44-82b3-0db42259cd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Flow 'volume_create_manager' (72bbd244-bdc8-4e74-aae2-84a6c2350a33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:51 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6edd55b4-05df-4810-8979-26c6e754e44c tempest-CreateVolumesFromImageTest-1838173229 None] Created volume successfully.
Jul 04 00:01:52 devstack sudo[97993]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7035ada-e58d-4b63-ae33-9914b5bbce10 1073741824" returned: 0 in 0.928s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7035ada-e58d-4b63-ae33-9914b5bbce10 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:52 devstack sudo[97999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7035ada-e58d-4b63-ae33-9914b5bbce10
Jul 04 00:01:52 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Acquiring lock "cinder-db24c738-29b5-470d-a7b8-bfc4c398a343-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Lock "cinder-db24c738-29b5-470d-a7b8-bfc4c398a343-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Acquiring lock "cinder-quobyte-db24c738-29b5-470d-a7b8-bfc4c398a343" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Lock "cinder-quobyte-db24c738-29b5-470d-a7b8-bfc4c398a343" acquired by "delete_volume" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:52 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f10e1f7-3810-40d0-8d58-399ec7effeff]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-db24c738-29b5-470d-a7b8-bfc4c398a343 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:52 devstack sudo[98001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-db24c738-29b5-470d-a7b8-bfc4c398a343
Jul 04 00:01:52 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:53 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7035ada-e58d-4b63-ae33-9914b5bbce10" returned: 0 in 0.659s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.383s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1901459680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb99275dc93442fd8b3313ccc09279ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:50Z,use_quota=True,user_id='e2b47b40e6f3494980e431a58216c743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Creating volume 1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:53 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97696153-ccc5-4cd0-aa21-6d567d87ca4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7035ada-e58d-4b63-ae33-9914b5bbce10', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:53 devstack sudo[98004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09 1073741824
Jul 04 00:01:53 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7233026-40ef-4ceb-8dce-168d96edc908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:53 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Volume volume-a7035ada-e58d-4b63-ae33-9914b5bbce10 (a7035ada-e58d-4b63-ae33-9914b5bbce10): created successfully
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7233026-40ef-4ceb-8dce-168d96edc908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Flow 'volume_create_manager' (77f95121-3b99-4008-9f27-c7982b25c677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:53 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-27dd81ff-7e59-4c91-8672-38b7bcf0fb4d tempest-CreateVolumesFromImageTest-1838173229 None] Created volume successfully.
Jul 04 00:01:53 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-db24c738-29b5-470d-a7b8-bfc4c398a343" returned: 0 in 0.884s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-db24c738-29b5-470d-a7b8-bfc4c398a343 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:53 devstack sudo[98010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-db24c738-29b5-470d-a7b8-bfc4c398a343
Jul 04 00:01:53 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:54 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09 1073741824" returned: 0 in 0.857s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:54 devstack sudo[98015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09
Jul 04 00:01:54 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:54 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-db24c738-29b5-470d-a7b8-bfc4c398a343" returned: 0 in 0.667s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Lock "cinder-quobyte-db24c738-29b5-470d-a7b8-bfc4c398a343" released by "delete_volume" :: held 1.598s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Created reservations ['c67eb270-d7fd-4305-a15f-9c244e5743dc', 'b7c219f3-4e11-49f7-aaca-a9ed70390f7e', '68e4b706-ef3f-4723-993b-45165a03e1d2', 'd7dc2b7d-82fb-4f5c-b9ff-7c8322a709ed'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:54 devstack sudo[98018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:01:54 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:54 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09" returned: 0 in 0.658s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.640s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1606853189',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73648568-1423-4e02-907b-10747a709028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb99275dc93442fd8b3313ccc09279ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:50Z,use_quota=True,user_id='e2b47b40e6f3494980e431a58216c743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Creating volume 73648568-1423-4e02-907b-10747a709028 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:54 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73648568-1423-4e02-907b-10747a709028 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:54 devstack sudo[98021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73648568-1423-4e02-907b-10747a709028 1073741824
Jul 04 00:01:54 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827c156a-556f-4eed-a218-27173fc65ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1435912-19f6-4632-858f-6c98af4c3fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:54 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Volume volume-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09 (1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09): created successfully
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1435912-19f6-4632-858f-6c98af4c3fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Flow 'volume_create_manager' (037079aa-2219-4346-b53b-1eee164aed76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:54 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3414258b-7cff-41dd-8de2-65a908b35e06 tempest-CreateVolumesFromImageTest-1838173229 None] Created volume successfully.
Jul 04 00:01:55 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.676s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:01:55 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Deleted volume successfully.
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2a0e1395-85cc-4f32-a6f1-9d94a8a448bc tempest-VolumesTransfersTest-1417242590 None] Lock "cinder-db24c738-29b5-470d-a7b8-bfc4c398a343-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Flow 'volume_create_manager' (f88662bd-7059-4a31-bb7f-08450d857965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc859264-bedc-42e1-a67f-7f801d1c69c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc859264-bedc-42e1-a67f-7f801d1c69c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-254072171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489a8a38-a9b7-41bc-82a3-f9eb7606f04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7247653c79554beaa599858c2aeb8a99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:56Z,use_quota=True,user_id='859e5fd1962c43d0a2d98223d94e8142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40951a19-ddfa-463c-bf7f-c93444353c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40951a19-ddfa-463c-bf7f-c93444353c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9dd352-293b-41f7-8c63-272f563de220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f9dd352-293b-41f7-8c63-272f563de220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '489a8a38-a9b7-41bc-82a3-f9eb7606f04c', 'volume_name': 'volume-489a8a38-a9b7-41bc-82a3-f9eb7606f04c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d603e2b-3d60-4cbb-9efe-8cb9a9ef2a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d603e2b-3d60-4cbb-9efe-8cb9a9ef2a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3549c888-d5e3-4268-b174-9352252588e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:55 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Volume 489a8a38-a9b7-41bc-82a3-f9eb7606f04c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-489a8a38-a9b7-41bc-82a3-f9eb7606f04c', 'volume_size': 1}
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:55 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73648568-1423-4e02-907b-10747a709028 1073741824" returned: 0 in 0.879s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73648568-1423-4e02-907b-10747a709028 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:55 devstack sudo[98028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73648568-1423-4e02-907b-10747a709028
Jul 04 00:01:55 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:56 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73648568-1423-4e02-907b-10747a709028" returned: 0 in 0.690s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.725s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1842488896',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb99275dc93442fd8b3313ccc09279ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:50Z,use_quota=True,user_id='e2b47b40e6f3494980e431a58216c743',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Creating volume 14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:01:56 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=118,cinder:INSERT=44,cinder:UPDATE=146,cinder:DELETE=13 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5580ce-fa51-4e18-9d3d-7c890d526c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73648568-1423-4e02-907b-10747a709028', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:56 devstack sudo[98034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b 1073741824
Jul 04 00:01:56 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5629a52b-82a9-483e-a7d3-e4e39b9e1098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=106,cinder:INSERT=37,cinder:UPDATE=143,cinder:DELETE=11 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:01:56 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Volume volume-73648568-1423-4e02-907b-10747a709028 (73648568-1423-4e02-907b-10747a709028): created successfully
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5629a52b-82a9-483e-a7d3-e4e39b9e1098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Flow 'volume_create_manager' (d4f329c9-9b1a-4e64-96fb-01ff6d71cd8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:56 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-0e18a02c-4073-423a-a06e-7aae894a7620 tempest-CreateVolumesFromImageTest-1838173229 None] Created volume successfully.
Jul 04 00:01:57 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b 1073741824" returned: 0 in 0.846s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:57 devstack sudo[98043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b
Jul 04 00:01:57 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:58 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b" returned: 0 in 0.766s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:01:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:01:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e719ce7c-ab5a-4920-83e7-9e50be50d875 tempest-SnapshotsActionsTest-1770141133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.387s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:01:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e719ce7c-ab5a-4920-83e7-9e50be50d875 tempest-SnapshotsActionsTest-1770141133 None] Creating offline snapshot 320764ca-2d6a-4159-8d4a-88a890b9bc90 of volume ee36af36-b979-49af-ba8c-33f243c2d18d {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:01:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbff9b1a-9e40-4509-a919-62bae5f4d6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a1694f-9a65-4ea9-98dc-0efd39a27913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:01:58 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb2819e-6e84-4bbd-b172-118318ffaaeb]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e719ce7c-ab5a-4920-83e7-9e50be50d875 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:58 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Volume volume-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b (14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b): created successfully
Jul 04 00:01:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88a1694f-9a65-4ea9-98dc-0efd39a27913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:01:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Flow 'volume_create_manager' (2e80a18b-00ad-44e3-85ec-d1679b5ccac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:01:58 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-4bb6a0f1-9611-4eab-95ed-9218c46883bd tempest-CreateVolumesFromImageTest-1838173229 None] Created volume successfully.
Jul 04 00:01:58 devstack sudo[98046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a
Jul 04 00:01:58 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:58 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e719ce7c-ab5a-4920-83e7-9e50be50d875 tempest-SnapshotsActionsTest-1770141133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a" returned: 0 in 0.746s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e719ce7c-ab5a-4920-83e7-9e50be50d875 tempest-SnapshotsActionsTest-1770141133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee36af36-b979-49af-ba8c-33f243c2d18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:01:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e719ce7c-ab5a-4920-83e7-9e50be50d875 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:58 devstack sudo[98051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90 1G
Jul 04 00:01:58 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "cinder-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "cinder-quobyte-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:01:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-quobyte-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:01:59 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a32fa3-5030-47a3-a1b5-948c0766dfae]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:01:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:59 devstack sudo[98053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b
Jul 04 00:01:59 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:01:59 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root
Jul 04 00:01:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e719ce7c-ab5a-4920-83e7-9e50be50d875 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90 1G" returned: 0 in 0.855s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:01:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e719ce7c-ab5a-4920-83e7-9e50be50d875 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:01:59 devstack sudo[98058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90
Jul 04 00:01:59 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:00 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b" returned: 0 in 0.812s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:00 devstack sudo[98063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b
Jul 04 00:02:00 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:00 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e719ce7c-ab5a-4920-83e7-9e50be50d875 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90" returned: 0 in 0.723s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:00 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-e719ce7c-ab5a-4920-83e7-9e50be50d875 tempest-SnapshotsActionsTest-1770141133 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90 is being set with open permissions: ugo+rw
Jul 04 00:02:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e719ce7c-ab5a-4920-83e7-9e50be50d875 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:00 devstack sudo[98069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90
Jul 04 00:02:00 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:00 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b" returned: 0 in 0.758s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:00 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-quobyte-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b" released by "delete_volume" :: held 1.627s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Created reservations ['01cde648-3679-45c8-a0e3-002e3d880d2b', '246dfe53-c5d6-48e0-b14d-8eb9450b638f', '98f39f1e-44fb-459e-b11b-9a6be97ee121', 'e5b3e218-998d-47df-b642-96595935f295'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:01 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e719ce7c-ab5a-4920-83e7-9e50be50d875 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90" returned: 0 in 0.658s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e719ce7c-ab5a-4920-83e7-9e50be50d875 tempest-SnapshotsActionsTest-1770141133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.093s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.494s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-254072171',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=489a8a38-a9b7-41bc-82a3-f9eb7606f04c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7247653c79554beaa599858c2aeb8a99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:01:56Z,use_quota=True,user_id='859e5fd1962c43d0a2d98223d94e8142',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Creating volume 489a8a38-a9b7-41bc-82a3-f9eb7606f04c {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:02:01 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-489a8a38-a9b7-41bc-82a3-f9eb7606f04c 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:01 devstack sudo[98073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-489a8a38-a9b7-41bc-82a3-f9eb7606f04c 1073741824
Jul 04 00:02:01 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:01 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e719ce7c-ab5a-4920-83e7-9e50be50d875 tempest-SnapshotsActionsTest-1770141133 None] Create snapshot completed successfully
Jul 04 00:02:01 devstack sudo[98075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:02:01 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "cinder-73648568-1423-4e02-907b-10747a709028-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-73648568-1423-4e02-907b-10747a709028-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "cinder-quobyte-73648568-1423-4e02-907b-10747a709028" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-quobyte-73648568-1423-4e02-907b-10747a709028" acquired by "delete_volume" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b606aff-bf1f-433d-be86-caef55d3d055]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73648568-1423-4e02-907b-10747a709028 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:01 devstack sudo[98077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73648568-1423-4e02-907b-10747a709028
Jul 04 00:02:01 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:01 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.728s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:01 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:01 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Deleted volume successfully.
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3de076c0-1a6e-4bb0-90db-5caa81d1497b tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-14c5e05e-9ba7-4c5d-a5d5-f37498a9c40b-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Acquiring lock "cinder-320764ca-2d6a-4159-8d4a-88a890b9bc90-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-320764ca-2d6a-4159-8d4a-88a890b9bc90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Acquiring lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Acquiring lock "cinder-quobyte-320764ca-2d6a-4159-8d4a-88a890b9bc90" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-quobyte-320764ca-2d6a-4159-8d4a-88a890b9bc90" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Deleting offline snapshot 320764ca-2d6a-4159-8d4a-88a890b9bc90 of volume ee36af36-b979-49af-ba8c-33f243c2d18d {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] snapshot_file for this snap is: volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bea1f8e-efbd-4aab-9320-1d29f2162c96]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:02 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-489a8a38-a9b7-41bc-82a3-f9eb7606f04c 1073741824" returned: 0 in 1.005s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-489a8a38-a9b7-41bc-82a3-f9eb7606f04c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:02 devstack sudo[98084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-489a8a38-a9b7-41bc-82a3-f9eb7606f04c
Jul 04 00:02:02 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:02 devstack sudo[98083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90
Jul 04 00:02:02 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:02 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73648568-1423-4e02-907b-10747a709028" returned: 0 in 0.913s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73648568-1423-4e02-907b-10747a709028 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:02 devstack sudo[98090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73648568-1423-4e02-907b-10747a709028
Jul 04 00:02:02 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:02 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-489a8a38-a9b7-41bc-82a3-f9eb7606f04c" returned: 0 in 0.707s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3549c888-d5e3-4268-b174-9352252588e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-489a8a38-a9b7-41bc-82a3-f9eb7606f04c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:02 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21879dd5-fa98-4b1d-9028-bf298f0e7ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90" returned: 0 in 0.811s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee36af36-b979-49af-ba8c-33f243c2d18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4473e6f-ad96-4916-81e9-aa73e0a2e1f3]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:03 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Volume volume-489a8a38-a9b7-41bc-82a3-f9eb7606f04c (489a8a38-a9b7-41bc-82a3-f9eb7606f04c): created successfully
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21879dd5-fa98-4b1d-9028-bf298f0e7ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Flow 'volume_create_manager' (f88662bd-7059-4a31-bb7f-08450d857965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:03 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-402b241e-550e-44fe-ac1d-78418803a0d8 tempest-VolumesTransfersTest-732390950 None] Created volume successfully.
Jul 04 00:02:03 devstack sudo[98097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a
Jul 04 00:02:03 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:03 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-73648568-1423-4e02-907b-10747a709028" returned: 0 in 0.774s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-quobyte-73648568-1423-4e02-907b-10747a709028" released by "delete_volume" :: held 1.742s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Created reservations ['2a84d529-75bd-4bb0-9f98-f1f2d08de8bd', '8d91d630-943f-4ca0-bd72-60f3f9cdc935', 'fae79375-2418-47e6-81ff-c2e83fc04bad', 'dc2720f2-a18d-4a06-a203-43baf09a2a6e'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:03 devstack sudo[98101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:02:03 devstack sudo[98101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "cinder-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:03 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a" returned: 0 in 0.831s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee36af36-b979-49af-ba8c-33f243c2d18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:03 devstack sudo[98107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90
Jul 04 00:02:03 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "cinder-quobyte-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-quobyte-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09" acquired by "delete_volume" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[822ffadd-c0ee-49e9-8f87-9ac26a4671a7]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:04 devstack sudo[98109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09
Jul 04 00:02:04 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:04 devstack sudo[98101]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.730s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:04 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:04 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Deleted volume successfully.
Jul 04 00:02:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bf7e2613-ca59-470a-8213-93b7b93333b6 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-73648568-1423-4e02-907b-10747a709028-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Acquiring lock "cinder-489a8a38-a9b7-41bc-82a3-f9eb7606f04c-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Lock "cinder-489a8a38-a9b7-41bc-82a3-f9eb7606f04c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Acquiring lock "cinder-quobyte-489a8a38-a9b7-41bc-82a3-f9eb7606f04c" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Lock "cinder-quobyte-489a8a38-a9b7-41bc-82a3-f9eb7606f04c" acquired by "delete_volume" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:04 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c796dc6e-af84-4b2e-b64f-480b27626345]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-489a8a38-a9b7-41bc-82a3-f9eb7606f04c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:04 devstack sudo[98115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-489a8a38-a9b7-41bc-82a3-f9eb7606f04c
Jul 04 00:02:04 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:04 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90" returned: 0 in 0.900s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:04 devstack sudo[98120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90
Jul 04 00:02:04 devstack sudo[98120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:04 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09" returned: 0 in 0.912s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:04 devstack sudo[98122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09
Jul 04 00:02:04 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:05 devstack sudo[98120]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.320764ca-2d6a-4159-8d4a-88a890b9bc90" returned: 0 in 0.622s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:05 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-489a8a38-a9b7-41bc-82a3-f9eb7606f04c" returned: 0 in 0.846s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-489a8a38-a9b7-41bc-82a3-f9eb7606f04c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-quobyte-320764ca-2d6a-4159-8d4a-88a890b9bc90" released by "_delete_snapshot" :: held 3.282s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" released by "delete_snapshot" :: held 3.311s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:05 devstack sudo[98128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-489a8a38-a9b7-41bc-82a3-f9eb7606f04c
Jul 04 00:02:05 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:05 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Created reservations ['eca8df38-dde7-4273-8d3c-7c99fb6f98e0', '2afc64f6-3d04-4c39-b4f0-a2fdee0cb0e9', '30680a49-d254-41e0-9051-d83a3be309e0', 'b92abbe0-eec1-477d-b899-af0d7006f1c3'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:05 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Delete snapshot completed successfully.
Jul 04 00:02:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-71436577-1451-42cf-be42-c83c9c3b63b9 tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-320764ca-2d6a-4159-8d4a-88a890b9bc90-delete_snapshot" released by "delete_snapshot" :: held 3.500s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:05 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09" returned: 0 in 0.780s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-quobyte-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09" released by "delete_volume" :: held 1.740s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:05 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Created reservations ['58eb3435-7fc7-4291-b484-f99982f2407f', 'cfb4b1f2-b103-4254-8d0c-a2b657d899df', '44815747-fcb5-4889-a166-611b261eb750', 'afb17f1a-8c46-4f78-8422-5e53f8edcdf3'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:05 devstack sudo[98131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:02:05 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "cinder-a7035ada-e58d-4b63-ae33-9914b5bbce10-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-a7035ada-e58d-4b63-ae33-9914b5bbce10-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:06 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-489a8a38-a9b7-41bc-82a3-f9eb7606f04c" returned: 0 in 0.715s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "cinder-quobyte-a7035ada-e58d-4b63-ae33-9914b5bbce10" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Lock "cinder-quobyte-489a8a38-a9b7-41bc-82a3-f9eb7606f04c" released by "delete_volume" :: held 1.605s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-quobyte-a7035ada-e58d-4b63-ae33-9914b5bbce10" acquired by "delete_volume" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e43fc7-dc0a-4eae-8fbc-fdc6805d0dd0]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7035ada-e58d-4b63-ae33-9914b5bbce10 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Created reservations ['02c2ed17-a56d-4648-af23-e063f07bd256', '55d65c35-459c-438a-9cab-515352e75f8b', '6629421a-7ce9-4500-bfcc-2dc4408d8a15', 'e0a4d8a3-f7e5-4c7a-a898-495bfc59c572'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:06 devstack sudo[98134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7035ada-e58d-4b63-ae33-9914b5bbce10
Jul 04 00:02:06 devstack sudo[98134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:06 devstack sudo[98137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:02:06 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:06 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.707s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:06 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Deleted volume successfully.
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-63399aeb-bea5-4d5f-be14-212d34a34371 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-1b0a2a50-a6d2-4b76-8f59-db1b2ad6eb09-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-15aa8166-ffaf-4cba-9066-1ef068478e98 tempest-SnapshotsActionsTest-1770141133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-15aa8166-ffaf-4cba-9066-1ef068478e98 tempest-SnapshotsActionsTest-1770141133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-15aa8166-ffaf-4cba-9066-1ef068478e98 tempest-SnapshotsActionsTest-1770141133 None] Creating offline snapshot fae8b178-915f-4e10-81d5-4f60ec979bf1 of volume ee36af36-b979-49af-ba8c-33f243c2d18d {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f2e89c-bb34-4f12-9a95-3f4b0dc4746d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15aa8166-ffaf-4cba-9066-1ef068478e98 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:06 devstack sudo[98139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a
Jul 04 00:02:06 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:07 devstack sudo[98134]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7035ada-e58d-4b63-ae33-9914b5bbce10" returned: 0 in 0.984s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7035ada-e58d-4b63-ae33-9914b5bbce10 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:07 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.842s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:07 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:07 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Deleted volume successfully.
Jul 04 00:02:07 devstack sudo[98145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7035ada-e58d-4b63-ae33-9914b5bbce10
Jul 04 00:02:07 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-93a37d31-3570-44e0-8ec4-aaed0144cba2 tempest-VolumesTransfersTest-1417242590 None] Lock "cinder-489a8a38-a9b7-41bc-82a3-f9eb7606f04c-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:07 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15aa8166-ffaf-4cba-9066-1ef068478e98 tempest-SnapshotsActionsTest-1770141133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a" returned: 0 in 0.903s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-15aa8166-ffaf-4cba-9066-1ef068478e98 tempest-SnapshotsActionsTest-1770141133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee36af36-b979-49af-ba8c-33f243c2d18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:02:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15aa8166-ffaf-4cba-9066-1ef068478e98 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:07 devstack sudo[98150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1 1G
Jul 04 00:02:07 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:07 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7035ada-e58d-4b63-ae33-9914b5bbce10" returned: 0 in 0.711s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-quobyte-a7035ada-e58d-4b63-ae33-9914b5bbce10" released by "delete_volume" :: held 1.754s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:07 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Created reservations ['dc6fbd0b-2534-408b-9c44-d48e20931271', '878503d0-6f05-49bf-bf1b-d3b0c7937d84', '6a694144-950f-4186-9938-aeeba41c0eb9', 'e156ca6e-4c50-4611-8979-6d1fc8c3ba70'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:08 devstack sudo[98153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:02:08 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "cinder-1815228b-5ce7-44dc-9595-e9584708aebc-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-1815228b-5ce7-44dc-9595-e9584708aebc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "cinder-quobyte-1815228b-5ce7-44dc-9595-e9584708aebc" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-quobyte-1815228b-5ce7-44dc-9595-e9584708aebc" acquired by "delete_volume" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:08 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[09571647-27ea-40da-b35b-ae864ac9dbf7]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1815228b-5ce7-44dc-9595-e9584708aebc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:08 devstack sudo[98158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1815228b-5ce7-44dc-9595-e9584708aebc
Jul 04 00:02:08 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:08 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15aa8166-ffaf-4cba-9066-1ef068478e98 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1 1G" returned: 0 in 1.130s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15aa8166-ffaf-4cba-9066-1ef068478e98 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:08 devstack sudo[98160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1
Jul 04 00:02:08 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:09 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.001s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:09 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:09 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Deleted volume successfully.
Jul 04 00:02:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-26c6d8e4-b79c-406a-8203-725e8e3ad68a tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-a7035ada-e58d-4b63-ae33-9914b5bbce10-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:09 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1815228b-5ce7-44dc-9595-e9584708aebc" returned: 0 in 0.924s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1815228b-5ce7-44dc-9595-e9584708aebc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:09 devstack sudo[98166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1815228b-5ce7-44dc-9595-e9584708aebc
Jul 04 00:02:09 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:09 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15aa8166-ffaf-4cba-9066-1ef068478e98 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1" returned: 0 in 0.870s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:09 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-15aa8166-ffaf-4cba-9066-1ef068478e98 tempest-SnapshotsActionsTest-1770141133 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1 is being set with open permissions: ugo+rw
Jul 04 00:02:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15aa8166-ffaf-4cba-9066-1ef068478e98 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:09 devstack sudo[98171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1
Jul 04 00:02:09 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:10 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-1815228b-5ce7-44dc-9595-e9584708aebc" returned: 0 in 0.755s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-quobyte-1815228b-5ce7-44dc-9595-e9584708aebc" released by "delete_volume" :: held 1.725s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:10 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Created reservations ['fb98139d-dbf2-4c03-9033-7a1b593a434a', '28e717e8-2971-4d38-a8bc-52147bcda6b3', '454448b1-c612-4b92-acdd-7031816f496a', '1b568db5-762d-4bff-8c36-655410e34184'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:10 devstack sudo[98174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:02:10 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:10 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15aa8166-ffaf-4cba-9066-1ef068478e98 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1" returned: 0 in 0.736s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-15aa8166-ffaf-4cba-9066-1ef068478e98 tempest-SnapshotsActionsTest-1770141133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.774s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:10 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-15aa8166-ffaf-4cba-9066-1ef068478e98 tempest-SnapshotsActionsTest-1770141133 None] Create snapshot completed successfully
Jul 04 00:02:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Acquiring lock "cinder-fae8b178-915f-4e10-81d5-4f60ec979bf1-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-fae8b178-915f-4e10-81d5-4f60ec979bf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Acquiring lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:11 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.907s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:11 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:11 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Deleted volume successfully.
Jul 04 00:02:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Acquiring lock "cinder-quobyte-fae8b178-915f-4e10-81d5-4f60ec979bf1" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-quobyte-fae8b178-915f-4e10-81d5-4f60ec979bf1" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Deleting offline snapshot fae8b178-915f-4e10-81d5-4f60ec979bf1 of volume ee36af36-b979-49af-ba8c-33f243c2d18d {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:02:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] snapshot_file for this snap is: volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:02:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-64d80a00-65a9-4fa6-8aa1-8d3a6cf8ab70 tempest-CreateVolumesFromImageTest-1838173229 None] Lock "cinder-1815228b-5ce7-44dc-9595-e9584708aebc-delete_volume" released by "delete_volume" :: held 2.978s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:11 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[40314270-e8cf-468d-85d9-ced3afd35d70]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:11 devstack sudo[98179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1
Jul 04 00:02:11 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:12 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1" returned: 0 in 0.960s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee36af36-b979-49af-ba8c-33f243c2d18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:02:12 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8696137-36e1-464f-aeae-226d301d6088]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:12 devstack sudo[98184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a
Jul 04 00:02:12 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:13 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a" returned: 0 in 0.873s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee36af36-b979-49af-ba8c-33f243c2d18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:02:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:13 devstack sudo[98189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1
Jul 04 00:02:13 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:14 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1" returned: 0 in 0.920s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:14 devstack sudo[98196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1
Jul 04 00:02:14 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:02:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:14 devstack sudo[98198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:02:14 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:14 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.fae8b178-915f-4e10-81d5-4f60ec979bf1" returned: 0 in 0.777s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:14 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:02:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Flow 'volume_create_manager' (3f78714d-91dd-4a40-bfb2-4a7d105245c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc9c907-0abe-4433-8828-a7f9be294599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-quobyte-fae8b178-915f-4e10-81d5-4f60ec979bf1" released by "_delete_snapshot" :: held 3.720s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" released by "delete_snapshot" :: held 3.757s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acc9c907-0abe-4433-8828-a7f9be294599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbdd7e4-1b00-4043-b431-458f80f6d30e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ef722ecc65411791b4b7683b961a36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:15Z,use_quota=True,user_id='924e9c595f1445e3ace741b8d141de52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3920d4c-687f-4615-a432-08b6bf3ac659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3920d4c-687f-4615-a432-08b6bf3ac659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c317ec-8125-46a9-914e-1d0c73f06cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c317ec-8125-46a9-914e-1d0c73f06cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecbdd7e4-1b00-4043-b431-458f80f6d30e', 'volume_name': 'volume-ecbdd7e4-1b00-4043-b431-458f80f6d30e', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4617fe02-75d9-4ebc-b9ba-4f5261a0f3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4617fe02-75d9-4ebc-b9ba-4f5261a0f3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b91ce46-59f1-44dc-a093-7ea91e833b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:15 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Volume ecbdd7e4-1b00-4043-b431-458f80f6d30e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecbdd7e4-1b00-4043-b431-458f80f6d30e', 'volume_size': 1}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecbdd7e4-1b00-4043-b431-458f80f6d30e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ef722ecc65411791b4b7683b961a36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:15Z,use_quota=True,user_id='924e9c595f1445e3ace741b8d141de52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Creating volume ecbdd7e4-1b00-4043-b431-458f80f6d30e {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:02:15 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ecbdd7e4-1b00-4043-b431-458f80f6d30e 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:15 devstack sudo[98201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ecbdd7e4-1b00-4043-b431-458f80f6d30e 1073741824
Jul 04 00:02:15 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Created reservations ['aaa8749e-7991-47ac-a76a-f39b28c9b74b', '32e2253b-8418-48c7-8e16-bee23090ab3d', '582cf807-a092-4a63-b0f6-092da3dd3b8a', '4c3b06c3-59ed-4020-ae43-be2dc3dffcff'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:15 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Delete snapshot completed successfully.
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-44bb4abd-c8e5-462e-9bee-59ed9d637b7a tempest-SnapshotsActionsTest-994889978 None] Lock "cinder-fae8b178-915f-4e10-81d5-4f60ec979bf1-delete_snapshot" released by "delete_snapshot" :: held 4.140s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:15 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.909s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 28 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Flow 'volume_create_manager' (d10ec45c-ed9d-459d-b376-bbe2ead05538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37db760c-10de-4581-8de8-2525e8928aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37db760c-10de-4581-8de8-2525e8928aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-259236995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc67392-1aca-4eef-84fc-e3d469356a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4199f0609a43403d80fbe17be8de10c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:16Z,use_quota=True,user_id='1612011f71b340d7847beae7997f8836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310801b4-08f0-4398-9e07-38fdbb10f4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310801b4-08f0-4398-9e07-38fdbb10f4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4b22a2-382c-44a7-b733-3abde548fdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4b22a2-382c-44a7-b733-3abde548fdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bc67392-1aca-4eef-84fc-e3d469356a53', 'volume_name': 'volume-7bc67392-1aca-4eef-84fc-e3d469356a53', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00d3806-c61a-413d-9529-bf43afce1571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00d3806-c61a-413d-9529-bf43afce1571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51ec020-766e-478f-b2dd-e0dd3abb231d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:15 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Volume 7bc67392-1aca-4eef-84fc-e3d469356a53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bc67392-1aca-4eef-84fc-e3d469356a53', 'volume_size': 1}
Jul 04 00:02:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Acquiring lock "cinder-1943bc5a-fab2-4bd0-a635-3477360dcf5a-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Lock "cinder-1943bc5a-fab2-4bd0-a635-3477360dcf5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Acquiring lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Acquiring lock "cinder-quobyte-1943bc5a-fab2-4bd0-a635-3477360dcf5a" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Lock "cinder-quobyte-1943bc5a-fab2-4bd0-a635-3477360dcf5a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Deleting offline snapshot 1943bc5a-fab2-4bd0-a635-3477360dcf5a of volume ee36af36-b979-49af-ba8c-33f243c2d18d {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] snapshot_file for this snap is: volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[925b60c7-ab31-47ac-ba4f-acf7486bba3c]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:16 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ecbdd7e4-1b00-4043-b431-458f80f6d30e 1073741824" returned: 0 in 1.053s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ecbdd7e4-1b00-4043-b431-458f80f6d30e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:16 devstack sudo[98209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ecbdd7e4-1b00-4043-b431-458f80f6d30e
Jul 04 00:02:16 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:16 devstack sudo[98208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a
Jul 04 00:02:16 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:16 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ecbdd7e4-1b00-4043-b431-458f80f6d30e" returned: 0 in 0.678s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.998s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-259236995',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc67392-1aca-4eef-84fc-e3d469356a53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4199f0609a43403d80fbe17be8de10c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:16Z,use_quota=True,user_id='1612011f71b340d7847beae7997f8836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Creating volume 7bc67392-1aca-4eef-84fc-e3d469356a53 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:02:16 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7bc67392-1aca-4eef-84fc-e3d469356a53 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:16 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b91ce46-59f1-44dc-a093-7ea91e833b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecbdd7e4-1b00-4043-b431-458f80f6d30e', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:16 devstack sudo[98216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7bc67392-1aca-4eef-84fc-e3d469356a53 1073741824
Jul 04 00:02:16 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6de3cfc-db0e-46eb-9964-1c2ef733fc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a" returned: 0 in 0.781s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee36af36-b979-49af-ba8c-33f243c2d18d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:02:16 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Volume volume-ecbdd7e4-1b00-4043-b431-458f80f6d30e (ecbdd7e4-1b00-4043-b431-458f80f6d30e): created successfully
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6de3cfc-db0e-46eb-9964-1c2ef733fc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Flow 'volume_create_manager' (3f78714d-91dd-4a40-bfb2-4a7d105245c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e83bed7-1a6a-470a-a89a-cd65d46cfc2f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:16 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f46ea79a-ecfd-4072-8101-f5da4fcc412b tempest-CinderUnicodeTest-127043406 None] Created volume successfully.
Jul 04 00:02:17 devstack sudo[98218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d
Jul 04 00:02:17 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:17 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7bc67392-1aca-4eef-84fc-e3d469356a53 1073741824" returned: 0 in 0.825s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7bc67392-1aca-4eef-84fc-e3d469356a53 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:17 devstack sudo[98226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7bc67392-1aca-4eef-84fc-e3d469356a53
Jul 04 00:02:17 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:17 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d" returned: 0 in 0.811s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:17 devstack sudo[98228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a
Jul 04 00:02:17 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:18 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7bc67392-1aca-4eef-84fc-e3d469356a53" returned: 0 in 0.725s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c51ec020-766e-478f-b2dd-e0dd3abb231d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc67392-1aca-4eef-84fc-e3d469356a53', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0913d22-fb70-4a8f-9afe-615f55f06c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:18 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Volume volume-7bc67392-1aca-4eef-84fc-e3d469356a53 (7bc67392-1aca-4eef-84fc-e3d469356a53): created successfully
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0913d22-fb70-4a8f-9afe-615f55f06c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Flow 'volume_create_manager' (d10ec45c-ed9d-459d-b376-bbe2ead05538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:18 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:18 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bc016017-3bd7-429c-85ac-d80229ee928d tempest-VolumesTransfersV357Test-1610293520 None] Created volume successfully.
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a" returned: 0 in 0.771s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:18 devstack sudo[98235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a
Jul 04 00:02:18 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Flow 'volume_create_manager' (6b43cafd-e2ef-41c8-9fb8-a7462a5b6913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3594d634-9305-4df5-a4cd-625d00794fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3594d634-9305-4df5-a4cd-625d00794fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1927967770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232f7c5b-136f-4d23-9057-32674b956329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ef722ecc65411791b4b7683b961a36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:19Z,use_quota=True,user_id='924e9c595f1445e3ace741b8d141de52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65eaf7b5-efa6-48e3-9435-58a4ce98b8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65eaf7b5-efa6-48e3-9435-58a4ce98b8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d24c15-4ea3-4d4d-a8a1-f4a0be4973a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d24c15-4ea3-4d4d-a8a1-f4a0be4973a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '232f7c5b-136f-4d23-9057-32674b956329', 'volume_name': 'volume-232f7c5b-136f-4d23-9057-32674b956329', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6241806d-cb53-42d4-9609-99f20d23d0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6241806d-cb53-42d4-9609-99f20d23d0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae6e4cc-0f93-4de1-b295-c1ff4a56bb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:18 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Volume 232f7c5b-136f-4d23-9057-32674b956329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-232f7c5b-136f-4d23-9057-32674b956329', 'volume_size': 1}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1927967770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232f7c5b-136f-4d23-9057-32674b956329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32ef722ecc65411791b4b7683b961a36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:19Z,use_quota=True,user_id='924e9c595f1445e3ace741b8d141de52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Creating volume 232f7c5b-136f-4d23-9057-32674b956329 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:02:18 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:02:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:18 devstack sudo[98237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329 1073741824
Jul 04 00:02:18 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:19 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d.1943bc5a-fab2-4bd0-a635-3477360dcf5a" returned: 0 in 0.722s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Lock "cinder-quobyte-1943bc5a-fab2-4bd0-a635-3477360dcf5a" released by "_delete_snapshot" :: held 3.230s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" released by "delete_snapshot" :: held 3.259s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:19 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Created reservations ['e291fca2-565f-4d1d-b555-dc568344f903', '9094b798-d97a-4a98-a22c-d9c654099007', 'bdefb578-17ba-4bb7-b6f7-d600996ddde0', 'e6f4160b-03f8-4564-88c7-1ea2c7369c33'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:19 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Delete snapshot completed successfully.
Jul 04 00:02:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c38709c2-da70-424c-8146-f539352f32a1 tempest-SnapshotsActionsTest-1770141133 None] Lock "cinder-1943bc5a-fab2-4bd0-a635-3477360dcf5a-delete_snapshot" released by "delete_snapshot" :: held 3.450s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:19 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9c98801b-4d63-4c80-adfa-333986fe3a22 tempest-VolumesTransfersV357Test-1236651237 None] Transfer volume completed successfully.
Jul 04 00:02:19 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329 1073741824" returned: 0 in 0.938s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:19 devstack sudo[98244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329
Jul 04 00:02:19 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Acquiring lock "cinder-ee36af36-b979-49af-ba8c-33f243c2d18d-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Lock "cinder-ee36af36-b979-49af-ba8c-33f243c2d18d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:20 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329" returned: 0 in 0.679s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Acquiring lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ae6e4cc-0f93-4de1-b295-c1ff4a56bb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-232f7c5b-136f-4d23-9057-32674b956329', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cb0b30-a3e6-4327-b631-3134f825a631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" acquired by "delete_volume" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:20 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Volume volume-232f7c5b-136f-4d23-9057-32674b956329 (232f7c5b-136f-4d23-9057-32674b956329): created successfully
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cb0b30-a3e6-4327-b631-3134f825a631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Flow 'volume_create_manager' (6b43cafd-e2ef-41c8-9fb8-a7462a5b6913) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b8ebe0-5e46-48ca-be72-520819305d58]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Acquiring lock "cinder-7bc67392-1aca-4eef-84fc-e3d469356a53-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:20 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-fd12061a-49c8-4b5c-9293-65ab4c221f9e tempest-CinderUnicodeTest-127043406 None] Created volume successfully.
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Lock "cinder-7bc67392-1aca-4eef-84fc-e3d469356a53-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Acquiring lock "cinder-quobyte-7bc67392-1aca-4eef-84fc-e3d469356a53" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Lock "cinder-quobyte-7bc67392-1aca-4eef-84fc-e3d469356a53" acquired by "delete_volume" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92f9040-6020-4d27-9950-f874d9e25056]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7bc67392-1aca-4eef-84fc-e3d469356a53 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:20 devstack sudo[98247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d
Jul 04 00:02:20 devstack sudo[98247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:20 devstack sudo[98249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7bc67392-1aca-4eef-84fc-e3d469356a53
Jul 04 00:02:20 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] Creating offline snapshot b3c370de-a834-4d56-96d2-12320102577b of volume 232f7c5b-136f-4d23-9057-32674b956329 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:02:21 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08d3576-ed13-4978-a1a2-4c92ed5a201e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:21 devstack sudo[98251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329
Jul 04 00:02:21 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:21 devstack sudo[98247]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d" returned: 0 in 0.788s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:21 devstack sudo[98256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d
Jul 04 00:02:21 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:21 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7bc67392-1aca-4eef-84fc-e3d469356a53" returned: 0 in 0.834s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7bc67392-1aca-4eef-84fc-e3d469356a53 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:21 devstack sudo[98262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7bc67392-1aca-4eef-84fc-e3d469356a53
Jul 04 00:02:21 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:21 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329" returned: 0 in 0.857s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:21 devstack sudo[98268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b 1G
Jul 04 00:02:21 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:21 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ee36af36-b979-49af-ba8c-33f243c2d18d" returned: 0 in 0.681s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Lock "cinder-quobyte-ee36af36-b979-49af-ba8c-33f243c2d18d" released by "delete_volume" :: held 1.565s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Created reservations ['c55c3449-e0dc-424e-8b6e-c61acdfe2fcf', '6cbebaf7-02fe-4bf5-9bcb-3e51a50b2d28', 'e13ba9e1-0c96-4d6e-9081-93a4e9bc3042', '07752d8a-ac17-4811-8ba5-4e0c10f2d33a'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:22 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7bc67392-1aca-4eef-84fc-e3d469356a53" returned: 0 in 0.706s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:22 devstack sudo[98271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:02:22 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Lock "cinder-quobyte-7bc67392-1aca-4eef-84fc-e3d469356a53" released by "delete_volume" :: held 1.593s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Created reservations ['bb7e1a14-39d7-40bb-bb0c-cb60d07d95d6', '8e9b13ef-437f-4191-beaf-bf11819d8712', '40f28dbb-91c4-43d3-966a-42e151f66d5e', 'caf1b5de-f9d7-4ecd-9654-2fdc1fcc67a5'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:22 devstack sudo[98273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:02:22 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:22 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.754s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:22 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Deleted volume successfully.
Jul 04 00:02:22 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b 1G" returned: 0 in 1.054s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-232f7c5b-136f-4d23-9057-32674b956329 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3a035b79-3c5c-4a84-8c81-5a57e65b5404 tempest-SnapshotsActionsTest-1770141133 None] Lock "cinder-ee36af36-b979-49af-ba8c-33f243c2d18d-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:23 devstack sudo[98280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-232f7c5b-136f-4d23-9057-32674b956329 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b
Jul 04 00:02:23 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:23 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.883s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:23 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Deleted volume successfully.
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-658e46fe-3c6f-4713-8732-1e672745c9c5 tempest-VolumesTransfersV357Test-476964879 None] Lock "cinder-7bc67392-1aca-4eef-84fc-e3d469356a53-delete_volume" released by "delete_volume" :: held 2.722s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Flow 'volume_create_manager' (544fbe97-5044-4138-82b5-3a9d04a031af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (837e9f01-a872-49c2-807b-4e003a641a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (837e9f01-a872-49c2-807b-4e003a641a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1884489306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcc47dc-db22-4920-9deb-8722b2894c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4199f0609a43403d80fbe17be8de10c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:24Z,use_quota=True,user_id='1612011f71b340d7847beae7997f8836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96405181-0ba3-45f5-90ad-5c8c0d6b25e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96405181-0ba3-45f5-90ad-5c8c0d6b25e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987d7558-1756-49ae-8d7d-79daba352cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987d7558-1756-49ae-8d7d-79daba352cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bcc47dc-db22-4920-9deb-8722b2894c22', 'volume_name': 'volume-4bcc47dc-db22-4920-9deb-8722b2894c22', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269cdd41-8f89-448a-9be7-668764227f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269cdd41-8f89-448a-9be7-668764227f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4dba929-9de4-470c-9e8a-2ad085afa941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:23 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Volume 4bcc47dc-db22-4920-9deb-8722b2894c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bcc47dc-db22-4920-9deb-8722b2894c22', 'volume_size': 1}
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:23 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-232f7c5b-136f-4d23-9057-32674b956329 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b" returned: 0 in 0.871s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:23 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b is being set with open permissions: ugo+rw
Jul 04 00:02:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:23 devstack sudo[98287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b
Jul 04 00:02:23 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:24 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b" returned: 0 in 0.720s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:24 devstack sudo[98291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.info
Jul 04 00:02:24 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:25 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.info" returned: 0 in 0.699s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:25 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.info is being set with open permissions: ugo+rw
Jul 04 00:02:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:25 devstack sudo[98294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.info
Jul 04 00:02:25 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:25 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.info" returned: 0 in 0.692s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.991s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.286s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1884489306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bcc47dc-db22-4920-9deb-8722b2894c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4199f0609a43403d80fbe17be8de10c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:24Z,use_quota=True,user_id='1612011f71b340d7847beae7997f8836',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Creating volume 4bcc47dc-db22-4920-9deb-8722b2894c22 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:02:26 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4bcc47dc-db22-4920-9deb-8722b2894c22 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:26 devstack sudo[98297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4bcc47dc-db22-4920-9deb-8722b2894c22 1073741824
Jul 04 00:02:26 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:26 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-58d7e275-0693-4a90-adea-6af9552c409a tempest-CinderUnicodeTest-127043406 None] Create snapshot completed successfully
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Acquiring lock "cinder-b3c370de-a834-4d56-96d2-12320102577b-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Lock "cinder-b3c370de-a834-4d56-96d2-12320102577b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Acquiring lock "cinder-quobyte-232f7c5b-136f-4d23-9057-32674b956329" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Lock "cinder-quobyte-232f7c5b-136f-4d23-9057-32674b956329" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Acquiring lock "cinder-quobyte-b3c370de-a834-4d56-96d2-12320102577b" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Lock "cinder-quobyte-b3c370de-a834-4d56-96d2-12320102577b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Deleting offline snapshot b3c370de-a834-4d56-96d2-12320102577b of volume 232f7c5b-136f-4d23-9057-32674b956329 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] snapshot_file for this snap is: volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[703a423b-f62f-4723-8c3e-d59a66857789]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:26 devstack sudo[98299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b
Jul 04 00:02:26 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:26 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4bcc47dc-db22-4920-9deb-8722b2894c22 1073741824" returned: 0 in 0.942s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4bcc47dc-db22-4920-9deb-8722b2894c22 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:27 devstack sudo[98305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4bcc47dc-db22-4920-9deb-8722b2894c22
Jul 04 00:02:27 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:27 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b" returned: 0 in 0.874s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-232f7c5b-136f-4d23-9057-32674b956329(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:02:27 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[028c4636-74da-44a1-ae44-396d17296b15]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:27 devstack sudo[98310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329
Jul 04 00:02:27 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:27 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4bcc47dc-db22-4920-9deb-8722b2894c22" returned: 0 in 0.750s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:02:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4dba929-9de4-470c-9e8a-2ad085afa941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bcc47dc-db22-4920-9deb-8722b2894c22', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5b44d9-6bc6-4718-9026-6bd08c744f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:27 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Volume volume-4bcc47dc-db22-4920-9deb-8722b2894c22 (4bcc47dc-db22-4920-9deb-8722b2894c22): created successfully
Jul 04 00:02:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5b44d9-6bc6-4718-9026-6bd08c744f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Flow 'volume_create_manager' (544fbe97-5044-4138-82b5-3a9d04a031af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:27 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-aa63e9da-6f62-444b-a367-d5507f4110e9 tempest-VolumesTransfersV357Test-1610293520 None] Created volume successfully.
Jul 04 00:02:28 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329" returned: 0 in 0.833s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:28 devstack sudo[98316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b
Jul 04 00:02:28 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:29 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b" returned: 0 in 0.782s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:29 devstack sudo[98321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b
Jul 04 00:02:29 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Acquiring lock "cinder-4bcc47dc-db22-4920-9deb-8722b2894c22-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Lock "cinder-4bcc47dc-db22-4920-9deb-8722b2894c22-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Acquiring lock "cinder-quobyte-4bcc47dc-db22-4920-9deb-8722b2894c22" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Lock "cinder-quobyte-4bcc47dc-db22-4920-9deb-8722b2894c22" acquired by "delete_volume" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:29 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab8bf13-d84f-41a2-8261-631061a7a332]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4bcc47dc-db22-4920-9deb-8722b2894c22 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:29 devstack sudo[98323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4bcc47dc-db22-4920-9deb-8722b2894c22
Jul 04 00:02:29 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:29 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329.b3c370de-a834-4d56-96d2-12320102577b" returned: 0 in 0.698s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Lock "cinder-quobyte-b3c370de-a834-4d56-96d2-12320102577b" released by "_delete_snapshot" :: held 3.342s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Lock "cinder-quobyte-232f7c5b-136f-4d23-9057-32674b956329" released by "delete_snapshot" :: held 3.369s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:29 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Created reservations ['441fbf1b-b52c-4557-8b01-7264ccc569fa', 'd6d0b655-c1d6-485a-8a3d-7e76e320861f', '4d399c0c-c6e7-4b04-9b90-bb06d9fc2320', '6fa00a63-af1a-496f-b92e-da7e37b3ee58'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:29 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Delete snapshot completed successfully.
Jul 04 00:02:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-642eeb24-0e65-47dc-94ab-82d3d5917910 tempest-CinderUnicodeTest-127043406 None] Lock "cinder-b3c370de-a834-4d56-96d2-12320102577b-delete_snapshot" released by "delete_snapshot" :: held 3.552s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:30 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4bcc47dc-db22-4920-9deb-8722b2894c22" returned: 0 in 0.823s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4bcc47dc-db22-4920-9deb-8722b2894c22 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:30 devstack sudo[98330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4bcc47dc-db22-4920-9deb-8722b2894c22
Jul 04 00:02:30 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Acquiring lock "cinder-232f7c5b-136f-4d23-9057-32674b956329-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Lock "cinder-232f7c5b-136f-4d23-9057-32674b956329-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Acquiring lock "cinder-quobyte-232f7c5b-136f-4d23-9057-32674b956329" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Lock "cinder-quobyte-232f7c5b-136f-4d23-9057-32674b956329" acquired by "delete_volume" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:30 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b82b99-8d8c-4b8d-b6af-b04e51533d0b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:30 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4bcc47dc-db22-4920-9deb-8722b2894c22" returned: 0 in 0.741s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Lock "cinder-quobyte-4bcc47dc-db22-4920-9deb-8722b2894c22" released by "delete_volume" :: held 1.610s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:30 devstack sudo[98333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329
Jul 04 00:02:30 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:30 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Created reservations ['908216ec-e403-41ce-8ca8-a9342ef8a231', 'fa910d1d-eff3-486d-a4d3-9dc3ab7811de', '1b4058cb-5340-4c54-bbb7-b72f201a5efb', '01a58740-70ba-4439-9b74-cb81a485de87'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:31 devstack sudo[98335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:02:31 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:31 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329" returned: 0 in 0.888s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:31 devstack sudo[98342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329
Jul 04 00:02:31 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:31 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.728s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:31 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:31 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Deleted volume successfully.
Jul 04 00:02:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-acce4db4-6047-4753-8e48-ac188b61610a tempest-VolumesTransfersV357Test-476964879 None] Lock "cinder-4bcc47dc-db22-4920-9deb-8722b2894c22-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:32 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-232f7c5b-136f-4d23-9057-32674b956329" returned: 0 in 0.781s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Lock "cinder-quobyte-232f7c5b-136f-4d23-9057-32674b956329" released by "delete_volume" :: held 1.734s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:32 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Created reservations ['037e605d-cd7b-4f0d-9e90-39789b0851e4', '7189e103-e250-4421-9043-f5ecdb8e2cb5', '442e1ba0-380f-48d3-a5f4-7f870cfd9fd3', '9156c92f-01e1-4dae-a8ee-4848039d3851'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:32 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:32 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:32 devstack sudo[98345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:02:32 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Acquiring lock "cinder-ecbdd7e4-1b00-4043-b431-458f80f6d30e-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Lock "cinder-ecbdd7e4-1b00-4043-b431-458f80f6d30e-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Acquiring lock "cinder-quobyte-ecbdd7e4-1b00-4043-b431-458f80f6d30e" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Lock "cinder-quobyte-ecbdd7e4-1b00-4043-b431-458f80f6d30e" acquired by "delete_volume" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:33 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed4577e-0673-4dca-9595-43c5aaabbbec]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ecbdd7e4-1b00-4043-b431-458f80f6d30e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:33 devstack sudo[98347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ecbdd7e4-1b00-4043-b431-458f80f6d30e
Jul 04 00:02:33 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:33 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.899s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:33 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:33 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Deleted volume successfully.
Jul 04 00:02:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e580d00f-98f9-4373-be03-360fd6d0fc6f tempest-CinderUnicodeTest-127043406 None] Lock "cinder-232f7c5b-136f-4d23-9057-32674b956329-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:34 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ecbdd7e4-1b00-4043-b431-458f80f6d30e" returned: 0 in 1.174s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ecbdd7e4-1b00-4043-b431-458f80f6d30e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:34 devstack sudo[98355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ecbdd7e4-1b00-4043-b431-458f80f6d30e
Jul 04 00:02:34 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ecbdd7e4-1b00-4043-b431-458f80f6d30e" returned: 0 in 0.743s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:35 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Lock "cinder-quobyte-ecbdd7e4-1b00-4043-b431-458f80f6d30e" released by "delete_volume" :: held 1.979s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:35 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Created reservations ['7e07fe58-a344-45b3-8fbb-3cea7810c579', '22c8a842-3552-4883-83e9-78585038c8c1', 'd484c4d6-b17c-4d7a-9ce4-482466605cb0', '6c9efcc8-04b2-466f-b693-b707a040c96a'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:35 devstack sudo[98359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:02:35 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:36 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.804s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:36 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:36 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Deleted volume successfully.
Jul 04 00:02:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9575253f-02c3-422c-97d7-f3e5619b23ff tempest-CinderUnicodeTest-127043406 None] Lock "cinder-ecbdd7e4-1b00-4043-b431-458f80f6d30e-delete_volume" released by "delete_volume" :: held 3.147s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:39 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:02:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Flow 'volume_create_manager' (4539ff6a-b07e-47c2-b679-d6d2537c9d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ddf2c5-f0e4-4fab-b267-18b499ef533e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ddf2c5-f0e4-4fab-b267-18b499ef533e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2122529185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6070db7e-9351-4753-b63f-385472fdac0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9a72b30bae74b0e92ac5e414683833d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:40Z,use_quota=True,user_id='b16065191e0b4dd18a65f23413c75539',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7af3bdf-54aa-4898-b8c0-60ef9e452dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7af3bdf-54aa-4898-b8c0-60ef9e452dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228b8267-5972-46c7-b846-053457222f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (228b8267-5972-46c7-b846-053457222f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6070db7e-9351-4753-b63f-385472fdac0c', 'volume_name': 'volume-6070db7e-9351-4753-b63f-385472fdac0c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99048454-bd21-4c1d-b240-d13b7b9960a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99048454-bd21-4c1d-b240-d13b7b9960a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16edb820-4a45-40ba-8397-b99467445662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:40 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Volume 6070db7e-9351-4753-b63f-385472fdac0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6070db7e-9351-4753-b63f-385472fdac0c', 'volume_size': 1}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2122529185',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6070db7e-9351-4753-b63f-385472fdac0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9a72b30bae74b0e92ac5e414683833d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:40Z,use_quota=True,user_id='b16065191e0b4dd18a65f23413c75539',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Creating volume 6070db7e-9351-4753-b63f-385472fdac0c {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:02:40 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:02:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:40 devstack sudo[98364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c 1073741824
Jul 04 00:02:40 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:41 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c 1073741824" returned: 0 in 1.069s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:41 devstack sudo[98370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c
Jul 04 00:02:41 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:41 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c" returned: 0 in 0.739s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:41 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:02:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16edb820-4a45-40ba-8397-b99467445662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6070db7e-9351-4753-b63f-385472fdac0c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3acf5224-180f-4d2b-85a5-e26f6d6be22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:41 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Volume volume-6070db7e-9351-4753-b63f-385472fdac0c (6070db7e-9351-4753-b63f-385472fdac0c): created successfully
Jul 04 00:02:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3acf5224-180f-4d2b-85a5-e26f6d6be22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Flow 'volume_create_manager' (4539ff6a-b07e-47c2-b679-d6d2537c9d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:42 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-09768d24-4f52-4236-a0f1-86cc88e41e4e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Created volume successfully.
Jul 04 00:02:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Creating offline snapshot 7f84c2d6-1e9f-4b73-9ed2-504bb488a629 of volume 6070db7e-9351-4753-b63f-385472fdac0c {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:02:43 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e60cd21-c4be-4347-bbce-b15cc7955901]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:43 devstack sudo[98373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c
Jul 04 00:02:43 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:44 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c" returned: 0 in 1.040s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:44 devstack sudo[98379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629 1G
Jul 04 00:02:44 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:45 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629 1G" returned: 0 in 0.980s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6070db7e-9351-4753-b63f-385472fdac0c -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:45 devstack sudo[98385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6070db7e-9351-4753-b63f-385472fdac0c -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629
Jul 04 00:02:45 devstack sudo[98385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:46 devstack sudo[98385]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6070db7e-9351-4753-b63f-385472fdac0c -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629" returned: 0 in 0.861s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:46 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629 is being set with open permissions: ugo+rw
Jul 04 00:02:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:46 devstack sudo[98391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629
Jul 04 00:02:46 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:47 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629" returned: 0 in 1.024s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:47 devstack sudo[98394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.info
Jul 04 00:02:47 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:48 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.info" returned: 0 in 0.775s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:48 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.info is being set with open permissions: ugo+rw
Jul 04 00:02:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:48 devstack sudo[98397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.info
Jul 04 00:02:48 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:49 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.info" returned: 0 in 1.013s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.822s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:49 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ba3d4878-456a-40e0-9951-3e9b627f73f0 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Create snapshot completed successfully
Jul 04 00:02:50 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Acquiring lock "cinder-7f84c2d6-1e9f-4b73-9ed2-504bb488a629-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:50 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "cinder-7f84c2d6-1e9f-4b73-9ed2-504bb488a629-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:50 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Acquiring lock "cinder-quobyte-6070db7e-9351-4753-b63f-385472fdac0c" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:50 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "cinder-quobyte-6070db7e-9351-4753-b63f-385472fdac0c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:50 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Acquiring lock "cinder-quobyte-7f84c2d6-1e9f-4b73-9ed2-504bb488a629" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:50 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "cinder-quobyte-7f84c2d6-1e9f-4b73-9ed2-504bb488a629" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Deleting offline snapshot 7f84c2d6-1e9f-4b73-9ed2-504bb488a629 of volume 6070db7e-9351-4753-b63f-385472fdac0c {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:02:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] snapshot_file for this snap is: volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:02:50 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e125ce-9ee5-4351-a8fd-558db5dd75a5]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:50 devstack sudo[98436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629
Jul 04 00:02:50 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:51 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629" returned: 0 in 1.042s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6070db7e-9351-4753-b63f-385472fdac0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:02:51 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3bb75d-0643-4704-b98a-d07893030d23]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:51 devstack sudo[98441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c
Jul 04 00:02:51 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Flow 'volume_create_manager' (9c65f03c-0cd0-484c-9e08-b24c44ead8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208a8265-04f3-4825-8363-20e314d8416c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208a8265-04f3-4825-8363-20e314d8416c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-696065729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8597eace-9c6c-45bb-b1a9-998b8525c464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd07ed3021f45cbbbeda705f43237b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:52Z,use_quota=True,user_id='1dadedde0bb5448b8f3b03d5809e441c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f40be8-44f9-46e4-a0d6-45015f32098f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f40be8-44f9-46e4-a0d6-45015f32098f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6ef6e5-cd96-4c24-8d99-117a4d3f1dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6ef6e5-cd96-4c24-8d99-117a4d3f1dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8597eace-9c6c-45bb-b1a9-998b8525c464', 'volume_name': 'volume-8597eace-9c6c-45bb-b1a9-998b8525c464', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd0d454-7067-4c71-b844-922ed2382329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd0d454-7067-4c71-b844-922ed2382329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6322f15d-f20b-4f96-a4b0-2f0c5fa1cdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:52 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Volume 8597eace-9c6c-45bb-b1a9-998b8525c464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8597eace-9c6c-45bb-b1a9-998b8525c464', 'volume_size': 1}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-696065729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8597eace-9c6c-45bb-b1a9-998b8525c464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cd07ed3021f45cbbbeda705f43237b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:02:52Z,use_quota=True,user_id='1dadedde0bb5448b8f3b03d5809e441c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Creating volume 8597eace-9c6c-45bb-b1a9-998b8525c464 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:02:52 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:52 devstack sudo[98447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 1073741824
Jul 04 00:02:52 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:52 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c" returned: 0 in 1.047s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:52 devstack sudo[98449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629
Jul 04 00:02:52 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:53 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629" returned: 0 in 1.070s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:53 devstack sudo[98459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629
Jul 04 00:02:53 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:53 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 1073741824" returned: 0 in 1.277s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:53 devstack sudo[98461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464
Jul 04 00:02:53 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:54 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c.7f84c2d6-1e9f-4b73-9ed2-504bb488a629" returned: 0 in 0.860s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "cinder-quobyte-7f84c2d6-1e9f-4b73-9ed2-504bb488a629" released by "_delete_snapshot" :: held 4.249s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "cinder-quobyte-6070db7e-9351-4753-b63f-385472fdac0c" released by "delete_snapshot" :: held 4.278s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:54 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Created reservations ['cccac658-8dbc-46c1-a32f-c979074e8bac', '196737dc-7e26-47c5-b819-8e0d5e23ab4b', '1ef3df07-4f41-403d-9a34-31cc95328dd8', '67e47da9-725c-454d-a079-0d20f0f53893'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:54 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464" returned: 0 in 0.910s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] <== create_volume: return (2262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:02:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.265s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:54 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Delete snapshot completed successfully.
Jul 04 00:02:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6322f15d-f20b-4f96-a4b0-2f0c5fa1cdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8597eace-9c6c-45bb-b1a9-998b8525c464', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f78f8c-2656-43d1-893c-17d6ce3be25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:02:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-09d90293-9c53-49d5-8d2d-69bafc0dbd9e tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "cinder-7f84c2d6-1e9f-4b73-9ed2-504bb488a629-delete_snapshot" released by "delete_snapshot" :: held 4.469s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:54 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Volume volume-8597eace-9c6c-45bb-b1a9-998b8525c464 (8597eace-9c6c-45bb-b1a9-998b8525c464): created successfully
Jul 04 00:02:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f78f8c-2656-43d1-893c-17d6ce3be25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:02:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Flow 'volume_create_manager' (9c65f03c-0cd0-484c-9e08-b24c44ead8f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:02:54 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-b05ebf41-a553-4e13-9de1-412ddfb57bbe tempest-VolumesActionsTest-27936120 None] Created volume successfully.
Jul 04 00:02:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Acquiring lock "cinder-6070db7e-9351-4753-b63f-385472fdac0c-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "cinder-6070db7e-9351-4753-b63f-385472fdac0c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Acquiring lock "cinder-quobyte-6070db7e-9351-4753-b63f-385472fdac0c" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:02:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "cinder-quobyte-6070db7e-9351-4753-b63f-385472fdac0c" acquired by "delete_volume" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:02:55 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b387b6-65e5-480f-8452-58d871bf8d7d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:02:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:56 devstack sudo[98465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c
Jul 04 00:02:56 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:56 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c" returned: 0 in 0.837s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:56 devstack sudo[98479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c
Jul 04 00:02:56 devstack sudo[98479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:57 devstack sudo[98479]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6070db7e-9351-4753-b63f-385472fdac0c" returned: 0 in 0.930s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:57 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "cinder-quobyte-6070db7e-9351-4753-b63f-385472fdac0c" released by "delete_volume" :: held 1.854s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:02:57 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=143,cinder:DELETE=10,cinder:SELECT=100,cinder:INSERT=32 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:02:57 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=118,cinder:UPDATE=146,cinder:DELETE=14,cinder:INSERT=42 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:02:57 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Created reservations ['b934d36b-ed0e-4932-ba35-6742f6f81053', '2427130b-3a35-4440-9adb-74c68cc7a9bd', '833399de-9ef6-4324-9630-c3b5270048a4', 'c5591119-0078-4feb-b12b-32057fd42f45'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:02:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:02:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:02:57 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:02:57 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:02:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:02:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:02:58 devstack sudo[98482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:02:58 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:02:59 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root
Jul 04 00:02:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.016s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:02:59 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:02:59 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Deleted volume successfully.
Jul 04 00:02:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-499dc8e4-ecbd-4e94-88fc-703b85fd8576 tempest-VolumeSnapshotQuotasNegativeTestJSON-878731952 None] Lock "cinder-6070db7e-9351-4753-b63f-385472fdac0c-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Flow 'volume_create_manager' (8b3ea559-2cc9-4eb7-a633-8b59094c7120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82eeafb-294d-48cf-888c-cbc88f207288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82eeafb-294d-48cf-888c-cbc88f207288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2064291119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b67032-604c-439d-a787-889c2f151425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ddc25ac8bc4f9cacdf2c67fee1a49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:07Z,use_quota=True,user_id='6cd31225b99644358f163bf87e4ae845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1308c25-3a44-4567-9d91-e9db5127bb0d),volume_type_id=c1308c25-3a44-4567-9d91-e9db5127bb0d)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d81409-9000-4e09-9d74-8ea3e4408f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08d81409-9000-4e09-9d74-8ea3e4408f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3cb1e0-62fa-4831-8472-0c56fd090fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b3cb1e0-62fa-4831-8472-0c56fd090fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80b67032-604c-439d-a787-889c2f151425', 'volume_name': 'volume-80b67032-604c-439d-a787-889c2f151425', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a206e780-c93f-469c-88ea-521a73a568b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a206e780-c93f-469c-88ea-521a73a568b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f7fff0-e3be-4630-84a6-d99fb613925f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:06 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Volume 80b67032-604c-439d-a787-889c2f151425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80b67032-604c-439d-a787-889c2f151425', 'volume_size': 1}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2064291119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b67032-604c-439d-a787-889c2f151425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82ddc25ac8bc4f9cacdf2c67fee1a49a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:07Z,use_quota=True,user_id='6cd31225b99644358f163bf87e4ae845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1308c25-3a44-4567-9d91-e9db5127bb0d),volume_type_id=c1308c25-3a44-4567-9d91-e9db5127bb0d)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Creating volume 80b67032-604c-439d-a787-889c2f151425 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:03:06 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:03:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80b67032-604c-439d-a787-889c2f151425 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:06 devstack sudo[98507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80b67032-604c-439d-a787-889c2f151425 1073741824
Jul 04 00:03:06 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:07 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80b67032-604c-439d-a787-889c2f151425 1073741824" returned: 0 in 1.183s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80b67032-604c-439d-a787-889c2f151425 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:07 devstack sudo[98513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80b67032-604c-439d-a787-889c2f151425
Jul 04 00:03:07 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:08 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80b67032-604c-439d-a787-889c2f151425" returned: 0 in 0.914s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:03:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.159s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f7fff0-e3be-4630-84a6-d99fb613925f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80b67032-604c-439d-a787-889c2f151425', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b74628-71a6-4a37-8a8f-406da873e98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:08 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Volume volume-80b67032-604c-439d-a787-889c2f151425 (80b67032-604c-439d-a787-889c2f151425): created successfully
Jul 04 00:03:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56b74628-71a6-4a37-8a8f-406da873e98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Flow 'volume_create_manager' (8b3ea559-2cc9-4eb7-a633-8b59094c7120) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:08 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bcb7482c-342c-45c7-99ce-3c91a61565b7 tempest-VolumeTypesAccessTest-528099673 None] Created volume successfully.
Jul 04 00:03:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Acquiring lock "cinder-80b67032-604c-439d-a787-889c2f151425-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Lock "cinder-80b67032-604c-439d-a787-889c2f151425-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Acquiring lock "cinder-quobyte-80b67032-604c-439d-a787-889c2f151425" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Lock "cinder-quobyte-80b67032-604c-439d-a787-889c2f151425" acquired by "delete_volume" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:10 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da95579-e562-4781-b7f3-d66e939e86eb]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80b67032-604c-439d-a787-889c2f151425 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:10 devstack sudo[98549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80b67032-604c-439d-a787-889c2f151425
Jul 04 00:03:10 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:11 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80b67032-604c-439d-a787-889c2f151425" returned: 0 in 1.003s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80b67032-604c-439d-a787-889c2f151425 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:11 devstack sudo[98567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80b67032-604c-439d-a787-889c2f151425
Jul 04 00:03:11 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Flow 'volume_create_manager' (844517a5-440a-4a32-9759-d80236bdaea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142ee213-ad4f-4fda-aa44-ec1aed3435f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (142ee213-ad4f-4fda-aa44-ec1aed3435f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-678681246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8479c7ed-a137-4a3c-a4ad-881ce0a82fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a1e29f1b994c2e85f670d79a20b514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:12Z,use_quota=True,user_id='ce641c8c2c994cce861fa50e90f8eb7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febcb0c8-9f30-4894-b76a-b6df133ec2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (febcb0c8-9f30-4894-b76a-b6df133ec2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c00b614-aabd-4060-b8ab-4c4b8dc3ec47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c00b614-aabd-4060-b8ab-4c4b8dc3ec47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8479c7ed-a137-4a3c-a4ad-881ce0a82fad', 'volume_name': 'volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22309a9f-3d08-4dbd-b113-47f85fae6d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22309a9f-3d08-4dbd-b113-47f85fae6d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aafec676-e62f-46a1-bc92-83534f51b3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:11 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Volume 8479c7ed-a137-4a3c-a4ad-881ce0a82fad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad', 'volume_size': 1}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-678681246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8479c7ed-a137-4a3c-a4ad-881ce0a82fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a1e29f1b994c2e85f670d79a20b514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:12Z,use_quota=True,user_id='ce641c8c2c994cce861fa50e90f8eb7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Creating volume 8479c7ed-a137-4a3c-a4ad-881ce0a82fad {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:03:11 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:03:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:11 devstack sudo[98589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad 1073741824
Jul 04 00:03:11 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:12 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80b67032-604c-439d-a787-889c2f151425" returned: 0 in 0.923s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Lock "cinder-quobyte-80b67032-604c-439d-a787-889c2f151425" released by "delete_volume" :: held 2.002s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:12 devstack cinder-volume[86650]: WARNING cinder.quota [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1373029908 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1373029908, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:03:12 devstack cinder-volume[86650]: WARNING cinder.quota [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1373029908 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1373029908, it is now deprecated. Please use the default quota class for default quota.
Jul 04 00:03:12 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Created reservations ['ac4247d4-1d8a-48f6-bcc0-48ccf2a63e52', 'd15391d5-8f85-4367-b989-d2197994765e', 'c83363cc-c806-4bce-b114-7f734ccea1f7', '0c016eda-f95e-4351-b622-50e0892e687e'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:03:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:12 devstack sudo[98592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:03:12 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:13 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.868s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:13 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:03:13 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Deleted volume successfully.
Jul 04 00:03:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ed1e01b3-bdd6-4f56-816b-7f885aac7239 tempest-VolumeTypesAccessTest-528099673 None] Lock "cinder-80b67032-604c-439d-a787-889c2f151425-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:13 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad 1073741824" returned: 0 in 1.562s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:13 devstack sudo[98602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad
Jul 04 00:03:13 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:14 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad" returned: 0 in 0.954s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] <== create_volume: return (2581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:03:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.584s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:03:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aafec676-e62f-46a1-bc92-83534f51b3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:14 devstack sudo[98615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:03:14 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3739e564-acfd-4bb9-ad15-6d7083847bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:14 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Volume volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad (8479c7ed-a137-4a3c-a4ad-881ce0a82fad): created successfully
Jul 04 00:03:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3739e564-acfd-4bb9-ad15-6d7083847bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:14 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Flow 'volume_create_manager' (844517a5-440a-4a32-9759-d80236bdaea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:14 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-06ad49af-cbaa-47f0-87ce-71faef1541c3 tempest-SnapshotDependencyTests-869400311 None] Created volume successfully.
Jul 04 00:03:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f9a97802-568a-45b4-ada7-0c042d079b72 tempest-VolumesActionsTest-27936120 None] Acquiring lock "cinder-8597eace-9c6c-45bb-b1a9-998b8525c464" by "attach_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f9a97802-568a-45b4-ada7-0c042d079b72 tempest-VolumesActionsTest-27936120 None] Lock "cinder-8597eace-9c6c-45bb-b1a9-998b8525c464" acquired by "attach_volume" :: waited 0.048s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:15 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f9a97802-568a-45b4-ada7-0c042d079b72 tempest-VolumesActionsTest-27936120 None] Attaching volume 8597eace-9c6c-45bb-b1a9-998b8525c464 to instance 49a5769f-36bf-49bd-b88c-166616c8357a at mountpoint /dev/vdb on host None.
Jul 04 00:03:15 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f9a97802-568a-45b4-ada7-0c042d079b72 tempest-VolumesActionsTest-27936120 None] Attach volume completed successfully.
Jul 04 00:03:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f9a97802-568a-45b4-ada7-0c042d079b72 tempest-VolumesActionsTest-27936120 None] Lock "cinder-8597eace-9c6c-45bb-b1a9-998b8525c464" released by "attach_volume" :: held 0.239s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:15 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.369s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:03:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e15797a7-f8c2-484e-9a04-9f5569a02b49 tempest-VolumesActionsTest-27936120 None] Acquiring lock "cinder-8597eace-9c6c-45bb-b1a9-998b8525c464-detach_volume" by "detach_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:03:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 28 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:03:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:03:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] Creating offline snapshot a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6 of volume 8479c7ed-a137-4a3c-a4ad-881ce0a82fad {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:03:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e15797a7-f8c2-484e-9a04-9f5569a02b49 tempest-VolumesActionsTest-27936120 None] Lock "cinder-8597eace-9c6c-45bb-b1a9-998b8525c464-detach_volume" acquired by "detach_volume" :: waited 0.071s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:15 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e15797a7-f8c2-484e-9a04-9f5569a02b49 tempest-VolumesActionsTest-27936120 None] Detaching volume 8597eace-9c6c-45bb-b1a9-998b8525c464 from instance 49a5769f-36bf-49bd-b88c-166616c8357a.
Jul 04 00:03:15 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb817268-5089-4897-a55a-f5ceeabbe374]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:16 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e15797a7-f8c2-484e-9a04-9f5569a02b49 tempest-VolumesActionsTest-27936120 None] Detach volume completed successfully.
Jul 04 00:03:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e15797a7-f8c2-484e-9a04-9f5569a02b49 tempest-VolumesActionsTest-27936120 None] Lock "cinder-8597eace-9c6c-45bb-b1a9-998b8525c464-detach_volume" released by "detach_volume" :: held 0.224s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:16 devstack sudo[98618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad
Jul 04 00:03:16 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:17 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad" returned: 0 in 1.302s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:17 devstack sudo[98623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6 1G
Jul 04 00:03:17 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:18 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6 1G" returned: 0 in 1.040s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:18 devstack sudo[98634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6
Jul 04 00:03:18 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:19 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6" returned: 0 in 0.924s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:19 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6 is being set with open permissions: ugo+rw
Jul 04 00:03:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:19 devstack sudo[98655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6
Jul 04 00:03:19 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:20 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6" returned: 0 in 0.844s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:20 devstack sudo[98660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.info
Jul 04 00:03:20 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:20 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.info" returned: 0 in 0.693s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:20 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.info is being set with open permissions: ugo+rw
Jul 04 00:03:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:20 devstack sudo[98663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.info
Jul 04 00:03:20 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:21 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.info" returned: 0 in 0.798s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.779s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:21 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c84b68ed-0ede-4f1a-859f-703f6b1d2bcb tempest-SnapshotDependencyTests-869400311 None] Create snapshot completed successfully
Jul 04 00:03:22 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:03:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Flow 'volume_create_manager' (e73af218-4eea-43ff-8062-0fe28c322c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e29d1c3-c5a2-4f10-9826-70dfa248f77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e29d1c3-c5a2-4f10-9826-70dfa248f77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bda2da58-74d7-480b-b331-2e8583608ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0a1e29f1b994c2e85f670d79a20b514',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:23Z,use_quota=True,user_id='ce641c8c2c994cce861fa50e90f8eb7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3cf27e-308d-4dbd-a318-c2baf8984bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e3cf27e-308d-4dbd-a318-c2baf8984bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07267b5-7af6-4b0e-b2e8-d3fb5d866ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07267b5-7af6-4b0e-b2e8-d3fb5d866ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bda2da58-74d7-480b-b331-2e8583608ed9', 'volume_name': 'volume-bda2da58-74d7-480b-b331-2e8583608ed9', 'volume_size': 1, 'snapshot_id': 'a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7aedc79-1564-42b1-ad1a-c8bb4d632e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7aedc79-1564-42b1-ad1a-c8bb4d632e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703d0075-dd2a-4ba4-bbc9-89f20b5611b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:22 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Volume bda2da58-74d7-480b-b331-2e8583608ed9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bda2da58-74d7-480b-b331-2e8583608ed9', 'volume_size': 1, 'snapshot_id': 'a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6'}
Jul 04 00:03:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "cinder-quobyte-a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6-bda2da58-74d7-480b-b331-2e8583608ed9" by "_create_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-quobyte-a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6-bda2da58-74d7-480b-b331-2e8583608ed9" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Creating volume bda2da58-74d7-480b-b331-2e8583608ed9 from snapshot a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6 {{(pid=86650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "cinder-quobyte-bda2da58-74d7-480b-b331-2e8583608ed9" by "_copy_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-quobyte-bda2da58-74d7-480b-b331-2e8583608ed9" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] snapshot: a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6, volume: bda2da58-74d7-480b-b331-2e8583608ed9,  {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[73aae522-afad-416e-bd1e-a31f19f8d067]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:23 devstack sudo[98666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6
Jul 04 00:03:23 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:23 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6" returned: 0 in 0.813s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] will copy from snapshot at /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Creating direct copy from snapshot {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a152c62-2a7e-4210-a84b-5756e2269258]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:24 devstack sudo[98672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad
Jul 04 00:03:24 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:24 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad" returned: 0 in 0.884s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:24 devstack cinder-volume[86650]: DEBUG cinder.utils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Path /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bda2da58-74d7-480b-b331-2e8583608ed9 not found in is_blk_device check {{(pid=86650) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:03:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bda2da58-74d7-480b-b331-2e8583608ed9 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:24 devstack sudo[98677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bda2da58-74d7-480b-b331-2e8583608ed9
Jul 04 00:03:24 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:30 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bda2da58-74d7-480b-b331-2e8583608ed9" returned: 0 in 6.059s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:30 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0d0b46-495b-4684-babb-dda1ef5fbb82]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:31 devstack sudo[98694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad
Jul 04 00:03:31 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:31 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad" returned: 0 in 0.978s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:31 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Image conversion details: src /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad, size 1024.00 MB, duration 6.06 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bda2da58-74d7-480b-b331-2e8583608ed9 {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:03:31 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Converted 1024.00 MB image at 168.94 MB/s
Jul 04 00:03:31 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bda2da58-74d7-480b-b331-2e8583608ed9 is being set with open permissions: ugo+rw
Jul 04 00:03:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bda2da58-74d7-480b-b331-2e8583608ed9 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:31 devstack sudo[98699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bda2da58-74d7-480b-b331-2e8583608ed9
Jul 04 00:03:31 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:32 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bda2da58-74d7-480b-b331-2e8583608ed9" returned: 0 in 0.652s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-quobyte-bda2da58-74d7-480b-b331-2e8583608ed9" released by "_copy_volume_from_snapshot" :: held 9.534s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-quobyte-a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6-bda2da58-74d7-480b-b331-2e8583608ed9" released by "_create_volume_from_snapshot" :: held 9.574s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.592s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (703d0075-dd2a-4ba4-bbc9-89f20b5611b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bda2da58-74d7-480b-b331-2e8583608ed9', 'volume_size': 1, 'snapshot_id': 'a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e74b5f06-f8a4-405a-aa4c-8ffe05e0af1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:32 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Volume volume-bda2da58-74d7-480b-b331-2e8583608ed9 (bda2da58-74d7-480b-b331-2e8583608ed9): created successfully
Jul 04 00:03:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e74b5f06-f8a4-405a-aa4c-8ffe05e0af1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Flow 'volume_create_manager' (e73af218-4eea-43ff-8062-0fe28c322c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:32 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-a9859b13-7ed4-446e-abb5-58404a6ee38e tempest-SnapshotDependencyTests-869400311 None] Created volume successfully.
Jul 04 00:03:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "cinder-a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "cinder-quobyte-8479c7ed-a137-4a3c-a4ad-881ce0a82fad" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-quobyte-8479c7ed-a137-4a3c-a4ad-881ce0a82fad" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "cinder-quobyte-a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-quobyte-a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Deleting offline snapshot a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6 of volume 8479c7ed-a137-4a3c-a4ad-881ce0a82fad {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] snapshot_file for this snap is: volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c975e4f8-4b49-4995-9b7a-83c9d5c6b44c]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:33 devstack sudo[98702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6
Jul 04 00:03:33 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Flow 'volume_create_manager' (ca1658bf-c497-4953-ab34-36b6274ad3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c9ff159-601a-47b0-8d36-a8bf09e3a1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c9ff159-601a-47b0-8d36-a8bf09e3a1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1904443128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563de71a-bccf-456d-b04d-101c7ea7aa4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f3970afe7f4429a96dd3d03a65c753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:34Z,use_quota=True,user_id='7820df393a1b48798d7de98ac5d8f806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b583508-a744-4009-81f7-d90a969b19d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b583508-a744-4009-81f7-d90a969b19d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ea67f3-edc0-4bf0-ad3c-3412725aabb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85ea67f3-edc0-4bf0-ad3c-3412725aabb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '563de71a-bccf-456d-b04d-101c7ea7aa4d', 'volume_name': 'volume-563de71a-bccf-456d-b04d-101c7ea7aa4d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dacd6c06-8bb0-4cac-be8b-e28bf4edacaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dacd6c06-8bb0-4cac-be8b-e28bf4edacaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3fc9dfe-0f46-4e87-92db-75245cb30fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:33 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Volume 563de71a-bccf-456d-b04d-101c7ea7aa4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-563de71a-bccf-456d-b04d-101c7ea7aa4d', 'volume_size': 1}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1904443128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=563de71a-bccf-456d-b04d-101c7ea7aa4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f3970afe7f4429a96dd3d03a65c753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:34Z,use_quota=True,user_id='7820df393a1b48798d7de98ac5d8f806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Creating volume 563de71a-bccf-456d-b04d-101c7ea7aa4d {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:03:33 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:03:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-563de71a-bccf-456d-b04d-101c7ea7aa4d 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:33 devstack sudo[98705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-563de71a-bccf-456d-b04d-101c7ea7aa4d 1073741824
Jul 04 00:03:33 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:34 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6" returned: 0 in 1.368s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:34 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:03:34 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[033d549a-6c40-40b0-9d20-90ffaed52dd7]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:34 devstack sudo[98710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad
Jul 04 00:03:34 devstack sudo[98710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:35 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-563de71a-bccf-456d-b04d-101c7ea7aa4d 1073741824" returned: 0 in 1.223s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-563de71a-bccf-456d-b04d-101c7ea7aa4d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:35 devstack sudo[98722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-563de71a-bccf-456d-b04d-101c7ea7aa4d
Jul 04 00:03:35 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:35 devstack sudo[98710]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad" returned: 0 in 1.124s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:35 devstack sudo[98737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6
Jul 04 00:03:35 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:36 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-563de71a-bccf-456d-b04d-101c7ea7aa4d" returned: 0 in 0.844s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:03:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3fc9dfe-0f46-4e87-92db-75245cb30fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-563de71a-bccf-456d-b04d-101c7ea7aa4d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b241cc9-1b20-4636-846f-3f057e1879f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:36 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Volume volume-563de71a-bccf-456d-b04d-101c7ea7aa4d (563de71a-bccf-456d-b04d-101c7ea7aa4d): created successfully
Jul 04 00:03:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b241cc9-1b20-4636-846f-3f057e1879f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Flow 'volume_create_manager' (ca1658bf-c497-4953-ab34-36b6274ad3ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:36 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-cd81f9a1-a08e-4697-86d1-8235ec19059b tempest-VolumesTransfersV355Test-2048183321 None] Created volume successfully.
Jul 04 00:03:36 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6" returned: 0 in 0.851s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:36 devstack sudo[98745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6
Jul 04 00:03:36 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:37 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad.a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6" returned: 0 in 0.789s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-quobyte-a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6" released by "_delete_snapshot" :: held 4.288s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-quobyte-8479c7ed-a137-4a3c-a4ad-881ce0a82fad" released by "delete_snapshot" :: held 4.325s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:37 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Created reservations ['3c1ebd16-5946-4b94-bcf2-f80804111fba', '5d405f6c-5301-416e-b11d-320fb564df48', '3e3496f4-4ab9-4d57-a9ef-8c206ecd88e9', 'a37f0e41-9476-47d4-a94f-9e1c46599b19'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:03:37 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Delete snapshot completed successfully.
Jul 04 00:03:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6e63d9f2-2744-4c3a-8308-a400676e2554 tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-a9c07a47-c4b9-49df-a1b8-ae7935d2e1f6-delete_snapshot" released by "delete_snapshot" :: held 4.490s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:37 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-0c23cd89-4c12-4ecf-b55f-9798184416f9 tempest-VolumesTransfersV355Test-905914804 None] Transfer volume completed successfully.
Jul 04 00:03:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "cinder-8479c7ed-a137-4a3c-a4ad-881ce0a82fad-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-8479c7ed-a137-4a3c-a4ad-881ce0a82fad-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "cinder-quobyte-8479c7ed-a137-4a3c-a4ad-881ce0a82fad" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-quobyte-8479c7ed-a137-4a3c-a4ad-881ce0a82fad" acquired by "delete_volume" :: waited 0.030s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:38 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9c9010-ec84-45c8-acec-ea44f2f8854c]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Acquiring lock "cinder-563de71a-bccf-456d-b04d-101c7ea7aa4d-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Lock "cinder-563de71a-bccf-456d-b04d-101c7ea7aa4d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:38 devstack sudo[98750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad
Jul 04 00:03:38 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Acquiring lock "cinder-quobyte-563de71a-bccf-456d-b04d-101c7ea7aa4d" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Lock "cinder-quobyte-563de71a-bccf-456d-b04d-101c7ea7aa4d" acquired by "delete_volume" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:38 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9990e29-7a99-41a5-82a6-785e18d10eda]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-563de71a-bccf-456d-b04d-101c7ea7aa4d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:38 devstack sudo[98752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-563de71a-bccf-456d-b04d-101c7ea7aa4d
Jul 04 00:03:38 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:39 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad" returned: 0 in 1.299s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:39 devstack sudo[98803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad
Jul 04 00:03:39 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:39 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-563de71a-bccf-456d-b04d-101c7ea7aa4d" returned: 0 in 1.232s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-563de71a-bccf-456d-b04d-101c7ea7aa4d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:40 devstack sudo[98809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-563de71a-bccf-456d-b04d-101c7ea7aa4d
Jul 04 00:03:40 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:40 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8479c7ed-a137-4a3c-a4ad-881ce0a82fad" returned: 0 in 0.870s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:40 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-563de71a-bccf-456d-b04d-101c7ea7aa4d" returned: 0 in 0.715s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-quobyte-8479c7ed-a137-4a3c-a4ad-881ce0a82fad" released by "delete_volume" :: held 2.260s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Lock "cinder-quobyte-563de71a-bccf-456d-b04d-101c7ea7aa4d" released by "delete_volume" :: held 2.002s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Created reservations ['cfe81d1b-87da-4404-9fe5-553cb1072a2f', '96aca060-9325-45da-948a-6ad8966afe46', '03d9f011-484e-4621-a498-bbc01883385e', '6158d1a4-8dc6-4b84-bb28-0d0af38f6b36'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Created reservations ['3401bcef-af82-461b-b2f6-30c4c510a4d1', '41c973c9-d6e0-459f-9ddb-ff65fe394745', '63a5257f-6a30-4b27-94a1-75b811a0d266', '92d14c9d-8037-414b-b4b6-57b2529ef673'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:40 devstack sudo[98832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:03:40 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:41 devstack sudo[98834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:03:41 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "cinder-bda2da58-74d7-480b-b331-2e8583608ed9-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-bda2da58-74d7-480b-b331-2e8583608ed9-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:41 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Flow 'volume_create_manager' (67cd0f55-3e24-44d3-933a-3a7363658fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:42 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c167d19b-4ce0-41be-b936-30d564b962d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:42 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.119s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.051s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:03:42 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Deleted volume successfully.
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "cinder-quobyte-bda2da58-74d7-480b-b331-2e8583608ed9" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c167d19b-4ce0-41be-b936-30d564b962d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-901078372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cbf155-2db5-4553-a9f1-3d1a1296d5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f3970afe7f4429a96dd3d03a65c753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:42Z,use_quota=True,user_id='7820df393a1b48798d7de98ac5d8f806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929e08c1-9cbb-47c8-bb36-9d36054e9a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929e08c1-9cbb-47c8-bb36-9d36054e9a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2502e8-1c02-4193-b1d7-c4ead4155952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af2502e8-1c02-4193-b1d7-c4ead4155952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42cbf155-2db5-4553-a9f1-3d1a1296d5c2', 'volume_name': 'volume-42cbf155-2db5-4553-a9f1-3d1a1296d5c2', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd25ea1-14d3-45df-bd83-68ce418f40dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd25ea1-14d3-45df-bd83-68ce418f40dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c62d5b-e6c5-4662-be60-fe5e45f1215a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:42 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Volume 42cbf155-2db5-4553-a9f1-3d1a1296d5c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42cbf155-2db5-4553-a9f1-3d1a1296d5c2', 'volume_size': 1}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-901078372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cbf155-2db5-4553-a9f1-3d1a1296d5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4f3970afe7f4429a96dd3d03a65c753',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:03:42Z,use_quota=True,user_id='7820df393a1b48798d7de98ac5d8f806',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Creating volume 42cbf155-2db5-4553-a9f1-3d1a1296d5c2 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:03:42 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-42cbf155-2db5-4553-a9f1-3d1a1296d5c2 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:42 devstack sudo[98840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-42cbf155-2db5-4553-a9f1-3d1a1296d5c2 1073741824
Jul 04 00:03:42 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-quobyte-bda2da58-74d7-480b-b331-2e8583608ed9" acquired by "delete_volume" :: waited 0.115s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-057be0f1-b5ba-4489-bfe3-21f0b0bef5ba tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-8479c7ed-a137-4a3c-a4ad-881ce0a82fad-delete_volume" released by "delete_volume" :: held 3.802s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:42 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Deleted volume successfully.
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faf1958-4ebb-4a10-96ec-c86e2b352d42]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bda2da58-74d7-480b-b331-2e8583608ed9 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6664010f-6559-4b19-a5b4-6a09c12ee5dc tempest-VolumesTransfersV355Test-1662536665 None] Lock "cinder-563de71a-bccf-456d-b04d-101c7ea7aa4d-delete_volume" released by "delete_volume" :: held 3.570s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:42 devstack sudo[98842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bda2da58-74d7-480b-b331-2e8583608ed9
Jul 04 00:03:42 devstack sudo[98842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:43 devstack sudo[98842]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bda2da58-74d7-480b-b331-2e8583608ed9" returned: 0 in 1.122s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bda2da58-74d7-480b-b331-2e8583608ed9 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:43 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-42cbf155-2db5-4553-a9f1-3d1a1296d5c2 1073741824" returned: 0 in 1.218s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:43 devstack sudo[98851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bda2da58-74d7-480b-b331-2e8583608ed9
Jul 04 00:03:43 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-42cbf155-2db5-4553-a9f1-3d1a1296d5c2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:43 devstack sudo[98853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-42cbf155-2db5-4553-a9f1-3d1a1296d5c2
Jul 04 00:03:43 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:44 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bda2da58-74d7-480b-b331-2e8583608ed9" returned: 0 in 0.888s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-quobyte-bda2da58-74d7-480b-b331-2e8583608ed9" released by "delete_volume" :: held 2.090s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:44 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-42cbf155-2db5-4553-a9f1-3d1a1296d5c2" returned: 0 in 0.966s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] <== create_volume: return (2244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.247s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c62d5b-e6c5-4662-be60-fe5e45f1215a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42cbf155-2db5-4553-a9f1-3d1a1296d5c2', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990a7b69-1c26-45e1-a023-c752e538ce3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Created reservations ['6ad3206e-0676-49d7-abe4-feac8cfc5266', '27b47aeb-a29b-450b-8dc4-424b763802f6', 'b7b245a8-18ff-41f2-b279-589a7c973f63', 'c99db5c7-bf1f-433b-899a-1427ceaa49bd'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:03:44 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Volume volume-42cbf155-2db5-4553-a9f1-3d1a1296d5c2 (42cbf155-2db5-4553-a9f1-3d1a1296d5c2): created successfully
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990a7b69-1c26-45e1-a023-c752e538ce3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Flow 'volume_create_manager' (67cd0f55-3e24-44d3-933a-3a7363658fcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:03:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-65ac66fe-3900-47c2-b823-fadddd6be489 tempest-VolumesTransfersV355Test-2048183321 None] Created volume successfully.
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6ef7ef2c-b71a-4699-8771-d9940322e9c5 tempest-VolumesActionsTest-27936120 None] Acquiring lock "cinder-8597eace-9c6c-45bb-b1a9-998b8525c464" by "attach_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:44 devstack sudo[98858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:03:44 devstack sudo[98858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6ef7ef2c-b71a-4699-8771-d9940322e9c5 tempest-VolumesActionsTest-27936120 None] Lock "cinder-8597eace-9c6c-45bb-b1a9-998b8525c464" acquired by "attach_volume" :: waited 0.027s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6ef7ef2c-b71a-4699-8771-d9940322e9c5 tempest-VolumesActionsTest-27936120 None] Attaching volume 8597eace-9c6c-45bb-b1a9-998b8525c464 to instance 173e2ea5-5977-4be0-badc-f55cf6c94803 at mountpoint /dev/vdb on host None.
Jul 04 00:03:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6ef7ef2c-b71a-4699-8771-d9940322e9c5 tempest-VolumesActionsTest-27936120 None] Attach volume completed successfully.
Jul 04 00:03:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6ef7ef2c-b71a-4699-8771-d9940322e9c5 tempest-VolumesActionsTest-27936120 None] Lock "cinder-8597eace-9c6c-45bb-b1a9-998b8525c464" released by "attach_volume" :: held 0.132s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df1d9d83-108f-4b76-a02e-dc03aa55fb37 tempest-VolumesActionsTest-27936120 None] Acquiring lock "cinder-8597eace-9c6c-45bb-b1a9-998b8525c464-detach_volume" by "detach_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df1d9d83-108f-4b76-a02e-dc03aa55fb37 tempest-VolumesActionsTest-27936120 None] Lock "cinder-8597eace-9c6c-45bb-b1a9-998b8525c464-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:45 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-df1d9d83-108f-4b76-a02e-dc03aa55fb37 tempest-VolumesActionsTest-27936120 None] Detaching volume 8597eace-9c6c-45bb-b1a9-998b8525c464 from instance 173e2ea5-5977-4be0-badc-f55cf6c94803.
Jul 04 00:03:45 devstack sudo[98858]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.886s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:45 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:03:45 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Deleted volume successfully.
Jul 04 00:03:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Acquiring lock "cinder-42cbf155-2db5-4553-a9f1-3d1a1296d5c2-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-45b03011-21d7-46e5-90ce-bdc193616e8a tempest-SnapshotDependencyTests-869400311 None] Lock "cinder-bda2da58-74d7-480b-b331-2e8583608ed9-delete_volume" released by "delete_volume" :: held 3.614s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Lock "cinder-42cbf155-2db5-4553-a9f1-3d1a1296d5c2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:45 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-df1d9d83-108f-4b76-a02e-dc03aa55fb37 tempest-VolumesActionsTest-27936120 None] Detach volume completed successfully.
Jul 04 00:03:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df1d9d83-108f-4b76-a02e-dc03aa55fb37 tempest-VolumesActionsTest-27936120 None] Lock "cinder-8597eace-9c6c-45bb-b1a9-998b8525c464-detach_volume" released by "detach_volume" :: held 0.174s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Acquiring lock "cinder-quobyte-42cbf155-2db5-4553-a9f1-3d1a1296d5c2" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:03:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Lock "cinder-quobyte-42cbf155-2db5-4553-a9f1-3d1a1296d5c2" acquired by "delete_volume" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:03:45 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[95920d7c-61d9-4af6-b9a4-deb0c79888c4]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-42cbf155-2db5-4553-a9f1-3d1a1296d5c2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:45 devstack sudo[98861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-42cbf155-2db5-4553-a9f1-3d1a1296d5c2
Jul 04 00:03:45 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:46 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-42cbf155-2db5-4553-a9f1-3d1a1296d5c2" returned: 0 in 1.112s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-42cbf155-2db5-4553-a9f1-3d1a1296d5c2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:46 devstack sudo[98867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-42cbf155-2db5-4553-a9f1-3d1a1296d5c2
Jul 04 00:03:46 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:47 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-42cbf155-2db5-4553-a9f1-3d1a1296d5c2" returned: 0 in 0.830s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:47 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Lock "cinder-quobyte-42cbf155-2db5-4553-a9f1-3d1a1296d5c2" released by "delete_volume" :: held 2.026s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:47 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Created reservations ['a66337e5-cceb-44c2-b956-67f7485fef37', 'd78b547e-401c-4e13-9827-ff7f0c654629', '1f7e3803-8be8-4ae4-bff4-15900fef2a82', '4eb5ede3-8bbb-461a-98ba-c69588a979da'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:03:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:03:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:03:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:03:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:47 devstack sudo[98876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:03:47 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:48 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.802s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:48 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:03:48 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Deleted volume successfully.
Jul 04 00:03:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-34eef3f1-8b51-498d-a072-925cfa25b2a9 tempest-VolumesTransfersV355Test-1662536665 None] Lock "cinder-42cbf155-2db5-4553-a9f1-3d1a1296d5c2-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:03:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8e4566b9-a07a-46b3-90fe-e13fdfa9634f tempest-VolumesActionsTest-27936120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:03:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8e4566b9-a07a-46b3-90fe-e13fdfa9634f tempest-VolumesActionsTest-27936120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:03:56 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c51408-ed52-434d-a538-ad0bce6afac7]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8e4566b9-a07a-46b3-90fe-e13fdfa9634f tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:56 devstack sudo[98938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464
Jul 04 00:03:56 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:57 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8e4566b9-a07a-46b3-90fe-e13fdfa9634f tempest-VolumesActionsTest-27936120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464" returned: 0 in 1.048s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:57 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5c1d27-d0de-4cbb-99c9-82a939c3f6d3]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:03:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8e4566b9-a07a-46b3-90fe-e13fdfa9634f tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:57 devstack sudo[98949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464
Jul 04 00:03:57 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:58 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root
Jul 04 00:03:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8e4566b9-a07a-46b3-90fe-e13fdfa9634f tempest-VolumesActionsTest-27936120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464" returned: 0 in 0.957s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:03:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8e4566b9-a07a-46b3-90fe-e13fdfa9634f tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.3d4f5054-0bd7-45db-b30c-a8ac1bb11fb0l84ses6h.img {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:03:58 devstack sudo[98954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.3d4f5054-0bd7-45db-b30c-a8ac1bb11fb0l84ses6h.img
Jul 04 00:03:58 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:03:58 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=57,cinder:INSERT=19,cinder:UPDATE=78,cinder:DELETE=6 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:04:04 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8e4566b9-a07a-46b3-90fe-e13fdfa9634f tempest-VolumesActionsTest-27936120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.3d4f5054-0bd7-45db-b30c-a8ac1bb11fb0l84ses6h.img" returned: 0 in 5.472s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:04 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e75543-0cec-4afe-8369-fa4c4560e8b9]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8e4566b9-a07a-46b3-90fe-e13fdfa9634f tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:04 devstack sudo[98968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464
Jul 04 00:04:04 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:05 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8e4566b9-a07a-46b3-90fe-e13fdfa9634f tempest-VolumesActionsTest-27936120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464" returned: 0 in 1.260s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:05 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-8e4566b9-a07a-46b3-90fe-e13fdfa9634f tempest-VolumesActionsTest-27936120 None] Image conversion details: src /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464, size 1024.00 MB, duration 5.47 sec, destination /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.3d4f5054-0bd7-45db-b30c-a8ac1bb11fb0l84ses6h.img {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:04:05 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-8e4566b9-a07a-46b3-90fe-e13fdfa9634f tempest-VolumesActionsTest-27936120 None] Converted 1024.00 MB image at 187.11 MB/s
Jul 04 00:04:05 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=71,cinder:SELECT=67,cinder:INSERT=18,cinder:DELETE=6 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:04:05 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-8e4566b9-a07a-46b3-90fe-e13fdfa9634f tempest-VolumesActionsTest-27936120 None] 3d4f5054-0bd7-45db-b30c-a8ac1bb11fb0 was raw, no need to convert to raw {{(pid=86650) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 04 00:04:10 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:04:10 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Flow 'volume_create_manager' (2a10b7fb-0cd7-45b2-98e9-af1f4a769bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:04:10 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6579463-0a71-43f6-b9ae-4261e60cade1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:10 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6579463-0a71-43f6-b9ae-4261e60cade1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2086251820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd77c868-13b0-49a0-91c3-c61942e23893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ebe3bb9a8e48529c418ee41ee5c55b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:10Z,use_quota=True,user_id='9ed2c80dc4d8490382c8c46cbdb0fa3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:10 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a3d472-a7c4-458c-99cb-750f69e63735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:10 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a3d472-a7c4-458c-99cb-750f69e63735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:10 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0d4f16-40b5-4b61-89f0-beef377df4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:10 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0d4f16-40b5-4b61-89f0-beef377df4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd77c868-13b0-49a0-91c3-c61942e23893', 'volume_name': 'volume-fd77c868-13b0-49a0-91c3-c61942e23893', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:10 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92b4895-a34f-4f25-925c-7eb30b2d95c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:10 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a92b4895-a34f-4f25-925c-7eb30b2d95c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:10 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4abb9944-24d4-48ac-b434-204646a35257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:10 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Volume fd77c868-13b0-49a0-91c3-c61942e23893: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd77c868-13b0-49a0-91c3-c61942e23893', 'volume_size': 1}
Jul 04 00:04:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:04:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:14 devstack sudo[98974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:04:14 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:15 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.855s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:04:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:04:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:04:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:04:20 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:04:20 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=3 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:04:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8e4566b9-a07a-46b3-90fe-e13fdfa9634f tempest-VolumesActionsTest-27936120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.753s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8e4566b9-a07a-46b3-90fe-e13fdfa9634f tempest-VolumesActionsTest-27936120 None] Uploaded volume to glance image-id: 3d4f5054-0bd7-45db-b30c-a8ac1bb11fb0. {{(pid=86650) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 04 00:04:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.805s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2086251820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd77c868-13b0-49a0-91c3-c61942e23893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ebe3bb9a8e48529c418ee41ee5c55b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:10Z,use_quota=True,user_id='9ed2c80dc4d8490382c8c46cbdb0fa3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:04:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Creating volume fd77c868-13b0-49a0-91c3-c61942e23893 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:04:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:04:26 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:04:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:26 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-8e4566b9-a07a-46b3-90fe-e13fdfa9634f tempest-VolumesActionsTest-27936120 None] Copy volume to image completed successfully.
Jul 04 00:04:26 devstack sudo[98980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893 1073741824
Jul 04 00:04:26 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:27 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893 1073741824" returned: 0 in 0.843s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:27 devstack sudo[98985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893
Jul 04 00:04:27 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:27 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893" returned: 0 in 0.726s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:04:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.617s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4abb9944-24d4-48ac-b434-204646a35257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd77c868-13b0-49a0-91c3-c61942e23893', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea2660d-783c-4c49-9fcb-5d6a52016c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:27 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Volume volume-fd77c868-13b0-49a0-91c3-c61942e23893 (fd77c868-13b0-49a0-91c3-c61942e23893): created successfully
Jul 04 00:04:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ea2660d-783c-4c49-9fcb-5d6a52016c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Flow 'volume_create_manager' (2a10b7fb-0cd7-45b2-98e9-af1f4a769bca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:04:27 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-2ded1293-2d00-4aef-a8aa-c1d0eabe0d0f tempest-VolumesSnapshotTestJSON-1391804152 None] Created volume successfully.
Jul 04 00:04:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:28 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd78fe94-cbf4-4cfb-b2c7-27dc921188e1]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:28 devstack sudo[98988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464
Jul 04 00:04:28 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:29 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464" returned: 0 in 0.886s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:29 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0ddbec-97e3-4f51-a21a-a55fc3ee0cd9]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:29 devstack sudo[98993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464
Jul 04 00:04:29 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:30 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464" returned: 0 in 0.868s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.4c645db1-a055-4ba1-9258-7be50712200e7kkvzlh8.img {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:30 devstack sudo[98998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.4c645db1-a055-4ba1-9258-7be50712200e7kkvzlh8.img
Jul 04 00:04:30 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:34 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.4c645db1-a055-4ba1-9258-7be50712200e7kkvzlh8.img" returned: 0 in 4.509s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:34 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bba4efb-3788-43ae-9fe3-83ea30496c4e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:34 devstack sudo[99012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464
Jul 04 00:04:34 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:35 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464" returned: 0 in 0.987s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:35 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Image conversion details: src /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464, size 1024.00 MB, duration 4.51 sec, destination /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.4c645db1-a055-4ba1-9258-7be50712200e7kkvzlh8.img {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:04:35 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Converted 1024.00 MB image at 227.05 MB/s
Jul 04 00:04:35 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] 4c645db1-a055-4ba1-9258-7be50712200e was raw, converting to qcow2 {{(pid=86650) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 04 00:04:35 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8dd99a-96e9-44ca-8077-b6a19b2f9408]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.4c645db1-a055-4ba1-9258-7be50712200e7kkvzlh8.img {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:35 devstack sudo[99018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.4c645db1-a055-4ba1-9258-7be50712200e7kkvzlh8.img
Jul 04 00:04:35 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:36 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.4c645db1-a055-4ba1-9258-7be50712200e7kkvzlh8.img" returned: 0 in 0.733s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.4c645db1-a055-4ba1-9258-7be50712200e7kkvzlh8.img {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:36 devstack sudo[99022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.4c645db1-a055-4ba1-9258-7be50712200e7kkvzlh8.img
Jul 04 00:04:36 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:37 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.4c645db1-a055-4ba1-9258-7be50712200e7kkvzlh8.img" returned: 1 in 0.756s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.4c645db1-a055-4ba1-9258-7be50712200e7kkvzlh8.img' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:04:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.4c645db1-a055-4ba1-9258-7be50712200e7kkvzlh8.img /opt/stack/data/cinder/conversion/vol_upload_xjxinkkc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:37 devstack sudo[99027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.4c645db1-a055-4ba1-9258-7be50712200e7kkvzlh8.img /opt/stack/data/cinder/conversion/vol_upload_xjxinkkc
Jul 04 00:04:37 devstack sudo[99027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:37 devstack sudo[99027]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.4c645db1-a055-4ba1-9258-7be50712200e7kkvzlh8.img /opt/stack/data/cinder/conversion/vol_upload_xjxinkkc" returned: 0 in 0.683s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:37 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Image conversion details: src /opt/stack/data/cinder/conversion/8597eace-9c6c-45bb-b1a9-998b8525c464.temp_image.4c645db1-a055-4ba1-9258-7be50712200e7kkvzlh8.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_xjxinkkc {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:04:37 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 04 00:04:37 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4ff2b5-4e34-4647-a5bb-b9730c6f63ae]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xjxinkkc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:37 devstack sudo[99032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xjxinkkc
Jul 04 00:04:37 devstack sudo[99032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:38 devstack sudo[99032]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xjxinkkc" returned: 0 in 0.736s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:38 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1,cinder:SELECT=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:04:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.753s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Uploaded volume to glance image-id: 4c645db1-a055-4ba1-9258-7be50712200e. {{(pid=86650) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 04 00:04:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.202s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] Creating offline snapshot d1c41384-ddb4-4c96-bd36-73c507b94102 of volume fd77c868-13b0-49a0-91c3-c61942e23893 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:04:40 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c5e2de7a-f509-4286-a85b-fec0b488e73c tempest-VolumesActionsTest-27936120 None] Copy volume to image completed successfully.
Jul 04 00:04:40 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ec9610-45a9-4a23-85c7-a989ad119f94]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:40 devstack sudo[99039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893
Jul 04 00:04:40 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:40 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893" returned: 0 in 0.805s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:40 devstack sudo[99044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102 1G
Jul 04 00:04:40 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:41 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102 1G" returned: 0 in 0.828s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd77c868-13b0-49a0-91c3-c61942e23893 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:41 devstack sudo[99049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd77c868-13b0-49a0-91c3-c61942e23893 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102
Jul 04 00:04:41 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Acquiring lock "cinder-8597eace-9c6c-45bb-b1a9-998b8525c464-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Lock "cinder-8597eace-9c6c-45bb-b1a9-998b8525c464-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Acquiring lock "cinder-quobyte-8597eace-9c6c-45bb-b1a9-998b8525c464" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Lock "cinder-quobyte-8597eace-9c6c-45bb-b1a9-998b8525c464" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:41 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e88670-8a4c-4271-a820-7282dc5b3ddf]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:42 devstack sudo[99051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464
Jul 04 00:04:42 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:42 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd77c868-13b0-49a0-91c3-c61942e23893 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102" returned: 0 in 0.758s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:42 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102 is being set with open permissions: ugo+rw
Jul 04 00:04:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:42 devstack sudo[99056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102
Jul 04 00:04:42 devstack sudo[99056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:42 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464" returned: 0 in 0.774s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:42 devstack sudo[99061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464
Jul 04 00:04:42 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:43 devstack sudo[99056]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102" returned: 0 in 0.665s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:43 devstack sudo[99064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.info
Jul 04 00:04:43 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:43 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8597eace-9c6c-45bb-b1a9-998b8525c464" returned: 0 in 0.675s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Lock "cinder-quobyte-8597eace-9c6c-45bb-b1a9-998b8525c464" released by "delete_volume" :: held 1.496s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:43 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Created reservations ['501fa9df-4e07-4931-8899-7365cce3e408', '5a426ab5-f12c-4a1b-9103-68d3f688c919', '4be386a5-4753-4f59-b148-6eeef0f67299', '26aa5d97-1aaf-43c6-9382-cc735d310739'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:04:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:43 devstack sudo[99068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:04:43 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:43 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.info" returned: 0 in 0.655s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:43 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.info is being set with open permissions: ugo+rw
Jul 04 00:04:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:43 devstack sudo[99071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.info
Jul 04 00:04:43 devstack sudo[99071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:44 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.701s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:44 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:04:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Deleted volume successfully.
Jul 04 00:04:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7ef5645d-4baf-4895-b3fb-7dc287121fc8 tempest-VolumesActionsTest-27936120 None] Lock "cinder-8597eace-9c6c-45bb-b1a9-998b8525c464-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:44 devstack sudo[99071]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.info" returned: 0 in 0.681s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.487s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-8b7809b7-0041-4bfe-8a92-53b1f906a428 tempest-VolumesSnapshotTestJSON-1391804152 None] Create snapshot completed successfully
Jul 04 00:04:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-d1c41384-ddb4-4c96-bd36-73c507b94102-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-d1c41384-ddb4-4c96-bd36-73c507b94102-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-quobyte-fd77c868-13b0-49a0-91c3-c61942e23893" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-fd77c868-13b0-49a0-91c3-c61942e23893" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-quobyte-d1c41384-ddb4-4c96-bd36-73c507b94102" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-d1c41384-ddb4-4c96-bd36-73c507b94102" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Deleting offline snapshot d1c41384-ddb4-4c96-bd36-73c507b94102 of volume fd77c868-13b0-49a0-91c3-c61942e23893 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:04:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] snapshot_file for this snap is: volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:04:45 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89cff1a-1894-4b01-b0df-275bff41bcf6]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:45 devstack sudo[99076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102
Jul 04 00:04:45 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:46 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102" returned: 0 in 0.796s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd77c868-13b0-49a0-91c3-c61942e23893(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:04:46 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1564d8-d868-48fc-a984-d1345a7e7e4f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:46 devstack sudo[99082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893
Jul 04 00:04:46 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:47 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893" returned: 0 in 0.832s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:47 devstack sudo[99088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102
Jul 04 00:04:47 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:48 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102" returned: 0 in 0.795s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:48 devstack sudo[99095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102
Jul 04 00:04:48 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:49 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893.d1c41384-ddb4-4c96-bd36-73c507b94102" returned: 0 in 0.673s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-d1c41384-ddb4-4c96-bd36-73c507b94102" released by "_delete_snapshot" :: held 3.203s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-fd77c868-13b0-49a0-91c3-c61942e23893" released by "delete_snapshot" :: held 3.227s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:49 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Created reservations ['532d289e-06de-4bf7-82e7-2a523c97f14b', 'a9c65a03-7c41-429f-9bbd-ffaf9a3f960a', 'c6e4da94-1e2b-42c2-9fb1-704d18f3894b', '3a74b568-5a07-4e7b-97ee-b6dda185e9cc'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:04:49 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Delete snapshot completed successfully.
Jul 04 00:04:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-338b3a38-6468-4cfc-a1e4-af2876d2233f tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-d1c41384-ddb4-4c96-bd36-73c507b94102-delete_snapshot" released by "delete_snapshot" :: held 3.391s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Flow 'volume_create_manager' (64434488-f2e9-47fb-ab5e-d364ad5ca5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354da61f-8ef3-450f-9b46-ed9b794f5942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354da61f-8ef3-450f-9b46-ed9b794f5942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1482117175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630489d3-f48d-404c-a8d1-ef75ec0d27cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ebe3bb9a8e48529c418ee41ee5c55b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:51Z,use_quota=True,user_id='9ed2c80dc4d8490382c8c46cbdb0fa3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc3ae67-5f05-430f-bc81-781266a71131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dc3ae67-5f05-430f-bc81-781266a71131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f95995-b197-4ddb-845f-de992a475096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f95995-b197-4ddb-845f-de992a475096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '630489d3-f48d-404c-a8d1-ef75ec0d27cb', 'volume_name': 'volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9974e81a-566b-4dcc-9e5d-aada30a94f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9974e81a-566b-4dcc-9e5d-aada30a94f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443083b6-aba5-4e1a-8010-b10e0d466edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:50 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Volume 630489d3-f48d-404c-a8d1-ef75ec0d27cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb', 'volume_size': 1}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1482117175',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630489d3-f48d-404c-a8d1-ef75ec0d27cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ebe3bb9a8e48529c418ee41ee5c55b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:51Z,use_quota=True,user_id='9ed2c80dc4d8490382c8c46cbdb0fa3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Creating volume 630489d3-f48d-404c-a8d1-ef75ec0d27cb {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:04:50 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:04:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:50 devstack sudo[99134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb 1073741824
Jul 04 00:04:50 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:51 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb 1073741824" returned: 0 in 0.877s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:51 devstack sudo[99140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb
Jul 04 00:04:51 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:52 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb" returned: 0 in 0.673s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] <== create_volume: return (1597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:04:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443083b6-aba5-4e1a-8010-b10e0d466edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3671454f-eb45-4e2c-bacb-a6a0bef9a303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:52 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Volume volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb (630489d3-f48d-404c-a8d1-ef75ec0d27cb): created successfully
Jul 04 00:04:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3671454f-eb45-4e2c-bacb-a6a0bef9a303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Flow 'volume_create_manager' (64434488-f2e9-47fb-ab5e-d364ad5ca5d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:04:52 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e9a20723-97ce-429c-b95f-eb8bf741ca55 tempest-VolumesSnapshotTestJSON-1391804152 None] Created volume successfully.
Jul 04 00:04:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] Creating offline snapshot d523a8bc-2546-4f34-bca6-f5aa79f2b695 of volume 630489d3-f48d-404c-a8d1-ef75ec0d27cb {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:04:52 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece3a2b5-8dd5-4661-a38d-794e370ab9cf]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:53 devstack sudo[99144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb
Jul 04 00:04:53 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:53 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb" returned: 0 in 0.785s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:53 devstack sudo[99150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695 1G
Jul 04 00:04:53 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:54 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695 1G" returned: 0 in 0.990s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:54 devstack sudo[99156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695
Jul 04 00:04:54 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:55 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695" returned: 0 in 0.715s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:55 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695 is being set with open permissions: ugo+rw
Jul 04 00:04:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:55 devstack sudo[99161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695
Jul 04 00:04:55 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:56 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695" returned: 0 in 0.733s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:56 devstack sudo[99164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.info
Jul 04 00:04:56 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:56 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.info" returned: 0 in 0.727s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:56 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.info is being set with open permissions: ugo+rw
Jul 04 00:04:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:56 devstack sudo[99173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.info
Jul 04 00:04:56 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:57 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.info" returned: 0 in 0.676s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.730s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:57 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-43322d93-8edb-487e-b945-7ba1f3ebd10d tempest-VolumesSnapshotTestJSON-1391804152 None] Create snapshot completed successfully
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Flow 'volume_create_manager' (1e286653-c25f-4339-8782-50253bf09ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e6fba8-3243-46c0-9a70-f97f8a723739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03e6fba8-3243-46c0-9a70-f97f8a723739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1527823103',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77f9183-9fd9-45fc-8d7f-f452c05c29f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ebe3bb9a8e48529c418ee41ee5c55b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:04:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d523a8bc-2546-4f34-bca6-f5aa79f2b695,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:04:59Z,use_quota=True,user_id='9ed2c80dc4d8490382c8c46cbdb0fa3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a10eb8-af1e-4555-985a-b05f6590cc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8a10eb8-af1e-4555-985a-b05f6590cc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059da9c7-414b-44d3-a27e-d319f217860e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059da9c7-414b-44d3-a27e-d319f217860e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e77f9183-9fd9-45fc-8d7f-f452c05c29f6', 'volume_name': 'volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6', 'volume_size': 2, 'snapshot_id': 'd523a8bc-2546-4f34-bca6-f5aa79f2b695'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c34ef3f-0c70-4bc4-b46a-7efae22f1210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c34ef3f-0c70-4bc4-b46a-7efae22f1210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879f54d3-8c41-453e-b614-1448184fb773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:04:58 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Volume e77f9183-9fd9-45fc-8d7f-f452c05c29f6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6', 'volume_size': 2, 'snapshot_id': 'd523a8bc-2546-4f34-bca6-f5aa79f2b695'}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-quobyte-d523a8bc-2546-4f34-bca6-f5aa79f2b695-e77f9183-9fd9-45fc-8d7f-f452c05c29f6" by "_create_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-d523a8bc-2546-4f34-bca6-f5aa79f2b695-e77f9183-9fd9-45fc-8d7f-f452c05c29f6" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Creating volume e77f9183-9fd9-45fc-8d7f-f452c05c29f6 from snapshot d523a8bc-2546-4f34-bca6-f5aa79f2b695 {{(pid=86650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-quobyte-e77f9183-9fd9-45fc-8d7f-f452c05c29f6" by "_copy_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-e77f9183-9fd9-45fc-8d7f-f452c05c29f6" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:04:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] snapshot: d523a8bc-2546-4f34-bca6-f5aa79f2b695, volume: e77f9183-9fd9-45fc-8d7f-f452c05c29f6,  {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:04:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:04:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:04:59 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:04:59 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:04:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:04:59 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2f1b79-7773-4f3c-96fa-1d15d95f102d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:04:59 devstack sudo[99176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695
Jul 04 00:04:59 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:04:59 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root
Jul 04 00:04:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695" returned: 0 in 0.828s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:04:59 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:04:59 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] will copy from snapshot at /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:04:59 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Creating direct copy from snapshot {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:04:59 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed2f20c-5aff-47bd-9902-fbbdc0bb42d8]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:04:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:00 devstack sudo[99181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb
Jul 04 00:05:00 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:00 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb" returned: 0 in 1.010s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:00 devstack cinder-volume[86650]: DEBUG cinder.utils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Path /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6 not found in is_blk_device check {{(pid=86650) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:05:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:00 devstack sudo[99187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6
Jul 04 00:05:00 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:06 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6" returned: 0 in 5.689s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:06 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78c07fb-0050-4261-94fb-9054c2ed256a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:06 devstack sudo[99203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb
Jul 04 00:05:06 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:07 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb" returned: 0 in 1.176s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:07 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Image conversion details: src /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6 {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:05:07 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Converted 1024.00 MB image at 179.95 MB/s
Jul 04 00:05:07 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6 is being set with open permissions: ugo+rw
Jul 04 00:05:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:07 devstack sudo[99208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6
Jul 04 00:05:07 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:08 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6" returned: 0 in 0.729s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-e77f9183-9fd9-45fc-8d7f-f452c05c29f6" released by "_copy_volume_from_snapshot" :: held 9.605s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-d523a8bc-2546-4f34-bca6-f5aa79f2b695-e77f9183-9fd9-45fc-8d7f-f452c05c29f6" released by "_create_volume_from_snapshot" :: held 9.638s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.653s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (879f54d3-8c41-453e-b614-1448184fb773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6', 'volume_size': 2, 'snapshot_id': 'd523a8bc-2546-4f34-bca6-f5aa79f2b695'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1201a5-d6ed-4d1f-bd1a-9c15ddb987a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:08 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Volume volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6 (e77f9183-9fd9-45fc-8d7f-f452c05c29f6): created successfully
Jul 04 00:05:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1201a5-d6ed-4d1f-bd1a-9c15ddb987a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Flow 'volume_create_manager' (1e286653-c25f-4339-8782-50253bf09ca7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:05:08 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7a007817-9068-4f2d-ad02-fd29e092460b tempest-VolumesSnapshotTestJSON-1391804152 None] Created volume successfully.
Jul 04 00:05:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-e77f9183-9fd9-45fc-8d7f-f452c05c29f6-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-e77f9183-9fd9-45fc-8d7f-f452c05c29f6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-quobyte-e77f9183-9fd9-45fc-8d7f-f452c05c29f6" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-e77f9183-9fd9-45fc-8d7f-f452c05c29f6" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:09 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ebb89c-6378-4162-b2eb-b09240325a69]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:09 devstack sudo[99211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6
Jul 04 00:05:09 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:09 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6" returned: 0 in 0.853s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:09 devstack sudo[99216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6
Jul 04 00:05:09 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:10 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e77f9183-9fd9-45fc-8d7f-f452c05c29f6" returned: 0 in 0.672s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-e77f9183-9fd9-45fc-8d7f-f452c05c29f6" released by "delete_volume" :: held 1.606s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:10 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Created reservations ['c2b939e1-9abe-43f8-b3f5-79d18696065a', '450776c6-88c4-4334-8d70-4a4587ac5670', '662e8075-ab74-49cf-b6ab-f6c43b810fc7', '239578a1-508c-49c2-a230-4c4ef87c58a0'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:05:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:10 devstack sudo[99219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:05:10 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-d523a8bc-2546-4f34-bca6-f5aa79f2b695-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-d523a8bc-2546-4f34-bca6-f5aa79f2b695-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-quobyte-630489d3-f48d-404c-a8d1-ef75ec0d27cb" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-630489d3-f48d-404c-a8d1-ef75ec0d27cb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-quobyte-d523a8bc-2546-4f34-bca6-f5aa79f2b695" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-d523a8bc-2546-4f34-bca6-f5aa79f2b695" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Deleting offline snapshot d523a8bc-2546-4f34-bca6-f5aa79f2b695 of volume 630489d3-f48d-404c-a8d1-ef75ec0d27cb {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:05:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] snapshot_file for this snap is: volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:05:11 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcbc636-ebd3-4078-a78e-69f7079a3465]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:11 devstack sudo[99221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695
Jul 04 00:05:11 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:11 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.799s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:11 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:05:11 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Deleted volume successfully.
Jul 04 00:05:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-80409968-68d1-4cec-aacc-ad7dcafcff4b tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-e77f9183-9fd9-45fc-8d7f-f452c05c29f6-delete_volume" released by "delete_volume" :: held 2.701s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:12 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695" returned: 0 in 0.805s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:05:12 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a70762-6d81-4cbc-84fe-7f4b6b4c6e6f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:12 devstack sudo[99227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb
Jul 04 00:05:12 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:13 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb" returned: 0 in 0.951s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:13 devstack sudo[99232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695
Jul 04 00:05:13 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:13 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695" returned: 0 in 0.838s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:13 devstack sudo[99238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695
Jul 04 00:05:13 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:05:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:14 devstack sudo[99241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:05:14 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:14 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb.d523a8bc-2546-4f34-bca6-f5aa79f2b695" returned: 0 in 0.709s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-d523a8bc-2546-4f34-bca6-f5aa79f2b695" released by "_delete_snapshot" :: held 3.431s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-630489d3-f48d-404c-a8d1-ef75ec0d27cb" released by "delete_snapshot" :: held 3.456s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:14 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Created reservations ['55fe910b-af60-4844-8859-f20039f557a1', 'c1a7b370-262c-4180-95d3-23022425f02c', '5df70786-c5da-412c-8c52-46dd6d29bcc1', '462854fa-1ba7-49c9-8776-6ebeec82c6ed'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:05:14 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Delete snapshot completed successfully.
Jul 04 00:05:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-04657207-511a-4d21-89b2-6d77dea193d1 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-d523a8bc-2546-4f34-bca6-f5aa79f2b695-delete_snapshot" released by "delete_snapshot" :: held 3.624s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:15 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.724s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:05:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:05:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:05:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:05:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-630489d3-f48d-404c-a8d1-ef75ec0d27cb-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-630489d3-f48d-404c-a8d1-ef75ec0d27cb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-quobyte-630489d3-f48d-404c-a8d1-ef75ec0d27cb" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-630489d3-f48d-404c-a8d1-ef75ec0d27cb" acquired by "delete_volume" :: waited 0.013s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:15 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d074285f-fc73-43c7-9d44-3678bfe762da]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:15 devstack sudo[99245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb
Jul 04 00:05:15 devstack sudo[99245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:16 devstack sudo[99245]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb" returned: 0 in 0.811s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:16 devstack sudo[99250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb
Jul 04 00:05:16 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:17 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-630489d3-f48d-404c-a8d1-ef75ec0d27cb" returned: 0 in 0.695s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-630489d3-f48d-404c-a8d1-ef75ec0d27cb" released by "delete_volume" :: held 1.594s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:17 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Created reservations ['38d7a823-d7bf-4c39-99ca-39091181ad07', '6068c805-f044-4f01-8295-426ada688851', 'f870bd0e-7a92-4a76-bfba-c6749400cdda', 'd324c444-899b-44ed-b419-434b0e1c04db'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:05:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:17 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:17 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:17 devstack sudo[99256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:05:17 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:18 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.759s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:05:18 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Deleted volume successfully.
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a3bf5d39-e1b2-496a-9784-0eb41a94fdda tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-630489d3-f48d-404c-a8d1-ef75ec0d27cb-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Flow 'volume_create_manager' (9e038b96-56fb-4e2e-8f86-e3ff2fd99852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9226e247-6ed9-4386-9129-e94c44552f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9226e247-6ed9-4386-9129-e94c44552f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1302629666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6648995-3ca0-4f8b-902f-1dd988346d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ebe3bb9a8e48529c418ee41ee5c55b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:18Z,use_quota=True,user_id='9ed2c80dc4d8490382c8c46cbdb0fa3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47f614f-19cd-438c-b20b-f96d9011280a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f47f614f-19cd-438c-b20b-f96d9011280a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06711ae-b876-4f3d-91ed-de7c16e23d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06711ae-b876-4f3d-91ed-de7c16e23d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6648995-3ca0-4f8b-902f-1dd988346d5d', 'volume_name': 'volume-f6648995-3ca0-4f8b-902f-1dd988346d5d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac7a7ae-1b58-4ce0-b285-f4e0de754681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac7a7ae-1b58-4ce0-b285-f4e0de754681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef98f45f-4e7a-41f9-8c0c-ed1072c85446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:18 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Volume f6648995-3ca0-4f8b-902f-1dd988346d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6648995-3ca0-4f8b-902f-1dd988346d5d', 'volume_size': 1}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:05:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1302629666',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6648995-3ca0-4f8b-902f-1dd988346d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ebe3bb9a8e48529c418ee41ee5c55b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:18Z,use_quota=True,user_id='9ed2c80dc4d8490382c8c46cbdb0fa3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Creating volume f6648995-3ca0-4f8b-902f-1dd988346d5d {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:05:18 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:05:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:18 devstack sudo[99259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d 1073741824
Jul 04 00:05:18 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:19 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d 1073741824" returned: 0 in 0.876s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:19 devstack sudo[99265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d
Jul 04 00:05:19 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:20 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d" returned: 0 in 0.646s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:05:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef98f45f-4e7a-41f9-8c0c-ed1072c85446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6648995-3ca0-4f8b-902f-1dd988346d5d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1284cb5-6f37-41db-a6fc-58bc52ec356b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:20 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Volume volume-f6648995-3ca0-4f8b-902f-1dd988346d5d (f6648995-3ca0-4f8b-902f-1dd988346d5d): created successfully
Jul 04 00:05:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1284cb5-6f37-41db-a6fc-58bc52ec356b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Flow 'volume_create_manager' (9e038b96-56fb-4e2e-8f86-e3ff2fd99852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:05:20 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-dba0ec90-f932-47e1-896a-32f0db8ab0d9 tempest-VolumesSnapshotTestJSON-1391804152 None] Created volume successfully.
Jul 04 00:05:20 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=50,cinder:UPDATE=48,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:05:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] Creating offline snapshot f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0 of volume f6648995-3ca0-4f8b-902f-1dd988346d5d {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:05:20 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[687bd2b3-df8c-47e6-af5f-c276673696d1]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:20 devstack sudo[99268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d
Jul 04 00:05:20 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:21 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d" returned: 0 in 0.751s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:21 devstack sudo[99273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0 1G
Jul 04 00:05:21 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:22 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0 1G" returned: 0 in 0.826s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6648995-3ca0-4f8b-902f-1dd988346d5d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:22 devstack sudo[99280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6648995-3ca0-4f8b-902f-1dd988346d5d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0
Jul 04 00:05:22 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:23 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6648995-3ca0-4f8b-902f-1dd988346d5d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0" returned: 0 in 0.832s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:23 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0 is being set with open permissions: ugo+rw
Jul 04 00:05:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:23 devstack sudo[99288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0
Jul 04 00:05:23 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:23 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0" returned: 0 in 0.695s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:23 devstack sudo[99292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.info
Jul 04 00:05:23 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:24 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.info" returned: 0 in 0.749s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:24 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.info is being set with open permissions: ugo+rw
Jul 04 00:05:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:24 devstack sudo[99297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.info
Jul 04 00:05:24 devstack sudo[99297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:25 devstack sudo[99297]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.info" returned: 0 in 0.740s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.700s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:25 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-66dc4a03-3ec2-490a-aef0-c5b782f26783 tempest-VolumesSnapshotTestJSON-1391804152 None] Create snapshot completed successfully
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Flow 'volume_create_manager' (af4ba779-76fe-4095-bc7a-2c35b5cb5349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bf4152-25b2-4c0e-83ed-e0e7d34f46fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bf4152-25b2-4c0e-83ed-e0e7d34f46fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1879197873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d0ad792-1388-49d3-926e-801035bb3af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ebe3bb9a8e48529c418ee41ee5c55b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:26Z,use_quota=True,user_id='9ed2c80dc4d8490382c8c46cbdb0fa3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234876e3-88f7-49b1-91ba-51e938f22c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (234876e3-88f7-49b1-91ba-51e938f22c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d7767f-de39-4666-8ac4-0082430a8d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08d7767f-de39-4666-8ac4-0082430a8d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7d0ad792-1388-49d3-926e-801035bb3af1', 'volume_name': 'volume-7d0ad792-1388-49d3-926e-801035bb3af1', 'volume_size': 1, 'snapshot_id': 'f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99ab1ce-12ed-4af9-bc43-b71cc1bb2455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c99ab1ce-12ed-4af9-bc43-b71cc1bb2455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625f76ed-8e1e-4261-9361-fcff18316a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:26 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Volume 7d0ad792-1388-49d3-926e-801035bb3af1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7d0ad792-1388-49d3-926e-801035bb3af1', 'volume_size': 1, 'snapshot_id': 'f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0'}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-quobyte-f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0-7d0ad792-1388-49d3-926e-801035bb3af1" by "_create_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0-7d0ad792-1388-49d3-926e-801035bb3af1" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Creating volume 7d0ad792-1388-49d3-926e-801035bb3af1 from snapshot f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0 {{(pid=86650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-quobyte-7d0ad792-1388-49d3-926e-801035bb3af1" by "_copy_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-7d0ad792-1388-49d3-926e-801035bb3af1" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] snapshot: f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0, volume: 7d0ad792-1388-49d3-926e-801035bb3af1,  {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dbebb5-91ab-4db3-ac0f-c6b940b017f0]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:26 devstack sudo[99329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0
Jul 04 00:05:26 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0" returned: 0 in 0.802s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6648995-3ca0-4f8b-902f-1dd988346d5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:05:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] will copy from snapshot at /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:05:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Creating direct copy from snapshot {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:05:27 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:27 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[75801561-b83b-4628-82a5-243ebeec9ef7]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:27 devstack sudo[99338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d
Jul 04 00:05:27 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:28 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d" returned: 0 in 1.003s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:28 devstack cinder-volume[86650]: DEBUG cinder.utils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Path /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7d0ad792-1388-49d3-926e-801035bb3af1 not found in is_blk_device check {{(pid=86650) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:05:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7d0ad792-1388-49d3-926e-801035bb3af1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:28 devstack sudo[99385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7d0ad792-1388-49d3-926e-801035bb3af1
Jul 04 00:05:28 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:34 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7d0ad792-1388-49d3-926e-801035bb3af1" returned: 0 in 6.494s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:34 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[642c9932-bd5a-4c3f-bffc-b9f984824374]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:35 devstack sudo[99421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d
Jul 04 00:05:35 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Flow 'volume_create_manager' (15760cb2-7ef1-4765-a7e9-29e4929d23cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2d92bb-99cf-4d3b-bbda-b0716c643b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:36 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2d92bb-99cf-4d3b-bbda-b0716c643b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-253978804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0328e9-fb00-4cdf-bcee-305c79e3f7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f5b9ab05eb4b0ab75ca84c378e6a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:36Z,use_quota=True,user_id='958b1f4424e644d9a087a903ba9c0148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5591f021-0083-44fd-a032-43ebc53f8454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5591f021-0083-44fd-a032-43ebc53f8454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce27760-796e-4e48-a6d6-cc51637f2351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce27760-796e-4e48-a6d6-cc51637f2351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e0328e9-fb00-4cdf-bcee-305c79e3f7eb', 'volume_name': 'volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b44f73-6dae-421f-b5f0-a3e4359c2a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b44f73-6dae-421f-b5f0-a3e4359c2a5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17652735-5a24-4cdc-91b3-bdd4b534a71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:36 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Volume 5e0328e9-fb00-4cdf-bcee-305c79e3f7eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb', 'volume_size': 1}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d" returned: 0 in 1.159s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Image conversion details: src /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d, size 1024.00 MB, duration 6.50 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7d0ad792-1388-49d3-926e-801035bb3af1 {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:05:36 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Converted 1024.00 MB image at 157.66 MB/s
Jul 04 00:05:36 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7d0ad792-1388-49d3-926e-801035bb3af1 is being set with open permissions: ugo+rw
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7d0ad792-1388-49d3-926e-801035bb3af1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:36 devstack sudo[99427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7d0ad792-1388-49d3-926e-801035bb3af1
Jul 04 00:05:36 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:36 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7d0ad792-1388-49d3-926e-801035bb3af1" returned: 0 in 0.720s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-7d0ad792-1388-49d3-926e-801035bb3af1" released by "_copy_volume_from_snapshot" :: held 10.287s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0-7d0ad792-1388-49d3-926e-801035bb3af1" released by "_create_volume_from_snapshot" :: held 10.319s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.335s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.750s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-253978804',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0328e9-fb00-4cdf-bcee-305c79e3f7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11f5b9ab05eb4b0ab75ca84c378e6a61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:36Z,use_quota=True,user_id='958b1f4424e644d9a087a903ba9c0148',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Creating volume 5e0328e9-fb00-4cdf-bcee-305c79e3f7eb {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:05:36 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:36 devstack sudo[99430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb 1073741824
Jul 04 00:05:36 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625f76ed-8e1e-4261-9361-fcff18316a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d0ad792-1388-49d3-926e-801035bb3af1', 'volume_size': 1, 'snapshot_id': 'f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748c714f-19f7-4aa4-adaf-c53576ec677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:36 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Volume volume-7d0ad792-1388-49d3-926e-801035bb3af1 (7d0ad792-1388-49d3-926e-801035bb3af1): created successfully
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748c714f-19f7-4aa4-adaf-c53576ec677d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Flow 'volume_create_manager' (af4ba779-76fe-4095-bc7a-2c35b5cb5349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:05:37 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-10bd2ec2-18ed-472b-b9f0-691059dd8502 tempest-VolumesSnapshotTestJSON-1391804152 None] Created volume successfully.
Jul 04 00:05:37 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb 1073741824" returned: 0 in 0.840s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:37 devstack sudo[99435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb
Jul 04 00:05:37 devstack sudo[99435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-7d0ad792-1388-49d3-926e-801035bb3af1-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-7d0ad792-1388-49d3-926e-801035bb3af1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-quobyte-7d0ad792-1388-49d3-926e-801035bb3af1" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-7d0ad792-1388-49d3-926e-801035bb3af1" acquired by "delete_volume" :: waited 0.046s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:38 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b13949-bbf4-4dac-bf45-b5c5572821ef]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7d0ad792-1388-49d3-926e-801035bb3af1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:38 devstack sudo[99437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7d0ad792-1388-49d3-926e-801035bb3af1
Jul 04 00:05:38 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:38 devstack sudo[99435]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb" returned: 0 in 0.747s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:05:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17652735-5a24-4cdc-91b3-bdd4b534a71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b97430-46ee-46b9-81d6-675baf61a6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:38 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Volume volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb (5e0328e9-fb00-4cdf-bcee-305c79e3f7eb): created successfully
Jul 04 00:05:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b97430-46ee-46b9-81d6-675baf61a6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Flow 'volume_create_manager' (15760cb2-7ef1-4765-a7e9-29e4929d23cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:05:38 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e0cc70ef-dda0-492d-9ecc-fa235a158316 tempest-TestMinimumBasicScenario-1651554483 None] Created volume successfully.
Jul 04 00:05:38 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7d0ad792-1388-49d3-926e-801035bb3af1" returned: 0 in 0.763s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7d0ad792-1388-49d3-926e-801035bb3af1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:38 devstack sudo[99445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7d0ad792-1388-49d3-926e-801035bb3af1
Jul 04 00:05:38 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:39 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7d0ad792-1388-49d3-926e-801035bb3af1" returned: 0 in 0.654s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-7d0ad792-1388-49d3-926e-801035bb3af1" released by "delete_volume" :: held 1.467s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:39 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=56,cinder:UPDATE=58,cinder:INSERT=13,cinder:DELETE=6 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:05:39 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Created reservations ['babdb7e9-3c68-4aaf-b990-51cb0a2e1bb4', '6816ae71-9d5a-4fd8-8ba6-c10159949f75', '1a22a9fc-17ca-4931-be7b-6fdd21daded3', '54f45704-6a2c-4fa5-ada6-7594f231322b'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:05:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:39 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:39 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:39 devstack sudo[99451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:05:39 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-quobyte-f6648995-3ca0-4f8b-902f-1dd988346d5d" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-f6648995-3ca0-4f8b-902f-1dd988346d5d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-quobyte-f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Deleting offline snapshot f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0 of volume f6648995-3ca0-4f8b-902f-1dd988346d5d {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:05:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] snapshot_file for this snap is: volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:05:40 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.643s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:40 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:05:40 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Deleted volume successfully.
Jul 04 00:05:40 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd320c11-8977-4a3b-baf3-edbb9a30a89d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6e4cf5e1-39b6-4d47-a449-2365afd74095 tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-7d0ad792-1388-49d3-926e-801035bb3af1-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:40 devstack sudo[99454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0
Jul 04 00:05:40 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:41 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0" returned: 0 in 0.789s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:41 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6648995-3ca0-4f8b-902f-1dd988346d5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:05:41 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbea8ba4-ff70-4fdf-9a28-71f976550e26]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:41 devstack sudo[99459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d
Jul 04 00:05:41 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:41 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d" returned: 0 in 0.871s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:42 devstack sudo[99464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0
Jul 04 00:05:42 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-7635d4e7-f376-4428-b479-3cff39d2031b req-2c280f88-8ec5-4345-9650-b074fb815613 tempest-TestMinimumBasicScenario-1651554483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-7635d4e7-f376-4428-b479-3cff39d2031b req-2c280f88-8ec5-4345-9650-b074fb815613 tempest-TestMinimumBasicScenario-1651554483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:42 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7554b4-d348-4fad-8197-7a93f5a1cfc4]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-7635d4e7-f376-4428-b479-3cff39d2031b req-2c280f88-8ec5-4345-9650-b074fb815613 tempest-TestMinimumBasicScenario-1651554483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:42 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0" returned: 0 in 0.793s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:42 devstack sudo[99478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0
Jul 04 00:05:42 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:42 devstack sudo[99477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb
Jul 04 00:05:42 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:43 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d.f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0" returned: 0 in 0.673s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0" released by "_delete_snapshot" :: held 3.254s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-f6648995-3ca0-4f8b-902f-1dd988346d5d" released by "delete_snapshot" :: held 3.283s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:43 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Created reservations ['7490b475-40a9-42d7-85d2-06bb40239f6f', '9e0d0bf8-e080-47ef-9f85-d9bbb2e2bd11', '898c5d79-2e74-4b9c-929e-8ec24d438463', 'b420f609-25fc-4470-98f6-211096b2568f'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:05:43 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Delete snapshot completed successfully.
Jul 04 00:05:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-5ebcc23c-e6f8-44e7-a3e8-7270b09e57bc tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-f6b72b4d-4d7b-4e8e-9ea9-e8b34824bbd0-delete_snapshot" released by "delete_snapshot" :: held 3.458s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:43 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-7635d4e7-f376-4428-b479-3cff39d2031b req-2c280f88-8ec5-4345-9650-b074fb815613 tempest-TestMinimumBasicScenario-1651554483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb" returned: 0 in 1.041s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-7635d4e7-f376-4428-b479-3cff39d2031b req-2c280f88-8ec5-4345-9650-b074fb815613 tempest-TestMinimumBasicScenario-1651554483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.064s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-7635d4e7-f376-4428-b479-3cff39d2031b req-2c280f88-8ec5-4345-9650-b074fb815613 tempest-TestMinimumBasicScenario-1651554483 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '973b1508-ff4c-4834-82ca-40d296b9bba4', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:05:43 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-7635d4e7-f376-4428-b479-3cff39d2031b req-2c280f88-8ec5-4345-9650-b074fb815613 tempest-TestMinimumBasicScenario-1651554483 None] attachment_update completed successfully.
Jul 04 00:05:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-f6648995-3ca0-4f8b-902f-1dd988346d5d-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-f6648995-3ca0-4f8b-902f-1dd988346d5d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-quobyte-f6648995-3ca0-4f8b-902f-1dd988346d5d" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-f6648995-3ca0-4f8b-902f-1dd988346d5d" acquired by "delete_volume" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:44 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3275d346-9f96-4113-8861-0d6051b68a29]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:44 devstack sudo[99570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d
Jul 04 00:05:44 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:45 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d" returned: 0 in 0.803s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:45 devstack sudo[99890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d
Jul 04 00:05:45 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:46 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f6648995-3ca0-4f8b-902f-1dd988346d5d" returned: 0 in 0.676s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-f6648995-3ca0-4f8b-902f-1dd988346d5d" released by "delete_volume" :: held 1.543s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Created reservations ['e1a8a8d6-77fc-473d-aee7-91d8ea25d5a6', 'eda415a3-8e6f-4f02-af69-c5481432de54', '1acaabb8-e315-4e4e-b2ea-2099dfd7eed1', '7770ed2a-89f2-474d-b43c-5e8672c511a6'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:46 devstack sudo[99893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:05:46 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-fd77c868-13b0-49a0-91c3-c61942e23893-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-fd77c868-13b0-49a0-91c3-c61942e23893-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "cinder-quobyte-fd77c868-13b0-49a0-91c3-c61942e23893" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:05:46 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.667s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-fd77c868-13b0-49a0-91c3-c61942e23893" acquired by "delete_volume" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:05:46 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Deleted volume successfully.
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46fe169-4044-40d8-b50b-c13cbd166555]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-06a6847d-f915-46a4-a36e-042e3b4408eb tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-f6648995-3ca0-4f8b-902f-1dd988346d5d-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:47 devstack sudo[99896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893
Jul 04 00:05:47 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:47 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893" returned: 0 in 0.793s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:47 devstack sudo[99901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893
Jul 04 00:05:47 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:48 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fd77c868-13b0-49a0-91c3-c61942e23893" returned: 0 in 0.675s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-quobyte-fd77c868-13b0-49a0-91c3-c61942e23893" released by "delete_volume" :: held 1.528s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:48 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Created reservations ['62ed6028-e21c-4493-9a30-aa88a10e7a33', '4b660ec2-62c9-4204-af3f-a2eea0ca5d39', '2ee4aa9e-cc12-436b-a74a-11ffff3e69d3', '2d47f4aa-3f6c-48cd-b21e-a103456c00ac'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:05:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:48 devstack sudo[99904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:05:48 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:49 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.693s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:49 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:05:49 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Deleted volume successfully.
Jul 04 00:05:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-fab92cda-2f46-4305-802e-87ef4e3bc47a tempest-VolumesSnapshotTestJSON-1391804152 None] Lock "cinder-fd77c868-13b0-49a0-91c3-c61942e23893-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:05:55 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:05:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Flow 'volume_create_manager' (c11e4bde-8051-4b68-bb3c-9972810b372a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:05:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6af708a-f086-4a8c-a376-5726193591bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6af708a-f086-4a8c-a376-5726193591bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2076876990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bd0359-4046-42d3-96fb-9062b18123d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35106eb4ad546c68532e4ac996259ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:56Z,use_quota=True,user_id='c4b93003ea8e468c97691f825902b71c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e8373b-0644-4452-b9d1-0ccaf553655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7e8373b-0644-4452-b9d1-0ccaf553655d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeddfda6-3b27-496f-a95a-25423774476a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeddfda6-3b27-496f-a95a-25423774476a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93bd0359-4046-42d3-96fb-9062b18123d3', 'volume_name': 'volume-93bd0359-4046-42d3-96fb-9062b18123d3', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0e64b9-e689-4452-be2f-a8c020af2288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0e64b9-e689-4452-be2f-a8c020af2288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38f5315-a4a9-45bc-8ca1-3ec050fa97c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:56 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Volume 93bd0359-4046-42d3-96fb-9062b18123d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93bd0359-4046-42d3-96fb-9062b18123d3', 'volume_size': 1}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2076876990',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93bd0359-4046-42d3-96fb-9062b18123d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35106eb4ad546c68532e4ac996259ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:05:56Z,use_quota=True,user_id='c4b93003ea8e468c97691f825902b71c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Creating volume 93bd0359-4046-42d3-96fb-9062b18123d3 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:05:56 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:56 devstack sudo[99957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3 1073741824
Jul 04 00:05:56 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:56 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3 1073741824" returned: 0 in 0.938s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:57 devstack sudo[99971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3
Jul 04 00:05:57 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:57 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3" returned: 0 in 0.666s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:57 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:05:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:05:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38f5315-a4a9-45bc-8ca1-3ec050fa97c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93bd0359-4046-42d3-96fb-9062b18123d3', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38456a1-a70d-491d-bba9-64d3557ab9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:05:57 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Volume volume-93bd0359-4046-42d3-96fb-9062b18123d3 (93bd0359-4046-42d3-96fb-9062b18123d3): created successfully
Jul 04 00:05:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38456a1-a70d-491d-bba9-64d3557ab9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:05:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Flow 'volume_create_manager' (c11e4bde-8051-4b68-bb3c-9972810b372a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:05:57 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-dea890ea-bd07-4e77-a8ab-5b59aa2c9b20 tempest-VolumesSnapshotListTestJSON-2085903411 None] Created volume successfully.
Jul 04 00:05:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:05:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:05:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] Creating offline snapshot 0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d of volume 93bd0359-4046-42d3-96fb-9062b18123d3 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:05:58 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f013c8-3e1b-41fb-814d-8936ee376e1c]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:05:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:58 devstack sudo[99974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3
Jul 04 00:05:58 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:59 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3" returned: 0 in 0.790s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:59 devstack sudo[99979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d 1G
Jul 04 00:05:59 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:05:59 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root
Jul 04 00:05:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d 1G" returned: 0 in 0.835s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:05:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93bd0359-4046-42d3-96fb-9062b18123d3 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:05:59 devstack sudo[99985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93bd0359-4046-42d3-96fb-9062b18123d3 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d
Jul 04 00:05:59 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:00 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93bd0359-4046-42d3-96fb-9062b18123d3 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d" returned: 0 in 0.736s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:00 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d is being set with open permissions: ugo+rw
Jul 04 00:06:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:00 devstack sudo[99990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d
Jul 04 00:06:00 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:01 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d" returned: 0 in 0.681s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:01 devstack sudo[99993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.info
Jul 04 00:06:01 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:02 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.info" returned: 0 in 0.664s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:02 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.info is being set with open permissions: ugo+rw
Jul 04 00:06:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:02 devstack sudo[99996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.info
Jul 04 00:06:02 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:02 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.info" returned: 0 in 0.702s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.514s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:02 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e1001571-6eb2-4189-a21d-fb43d44b6dac tempest-VolumesSnapshotListTestJSON-2085903411 None] Create snapshot completed successfully
Jul 04 00:06:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-32b698d1-89f5-46bd-8d69-0054e2f4a778 tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-32b698d1-89f5-46bd-8d69-0054e2f4a778 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:03 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-32b698d1-89f5-46bd-8d69-0054e2f4a778 tempest-VolumesSnapshotListTestJSON-2085903411 None] Creating offline snapshot 08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 of volume 93bd0359-4046-42d3-96fb-9062b18123d3 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:06:03 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[52857ff3-5bec-438e-839c-0a2c609639ea]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-32b698d1-89f5-46bd-8d69-0054e2f4a778 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:03 devstack sudo[100000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d
Jul 04 00:06:03 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:04 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-32b698d1-89f5-46bd-8d69-0054e2f4a778 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d" returned: 0 in 0.948s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-32b698d1-89f5-46bd-8d69-0054e2f4a778 tempest-VolumesSnapshotListTestJSON-2085903411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93bd0359-4046-42d3-96fb-9062b18123d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:06:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-32b698d1-89f5-46bd-8d69-0054e2f4a778 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:04 devstack sudo[100029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 1G
Jul 04 00:06:04 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:05 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-32b698d1-89f5-46bd-8d69-0054e2f4a778 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 1G" returned: 0 in 0.909s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-32b698d1-89f5-46bd-8d69-0054e2f4a778 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:05 devstack sudo[100035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6
Jul 04 00:06:05 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:06 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-32b698d1-89f5-46bd-8d69-0054e2f4a778 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6" returned: 0 in 0.682s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:06 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-32b698d1-89f5-46bd-8d69-0054e2f4a778 tempest-VolumesSnapshotListTestJSON-2085903411 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 is being set with open permissions: ugo+rw
Jul 04 00:06:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-32b698d1-89f5-46bd-8d69-0054e2f4a778 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:06 devstack sudo[100040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6
Jul 04 00:06:06 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:07 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-32b698d1-89f5-46bd-8d69-0054e2f4a778 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6" returned: 0 in 0.814s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-32b698d1-89f5-46bd-8d69-0054e2f4a778 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.462s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:07 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-32b698d1-89f5-46bd-8d69-0054e2f4a778 tempest-VolumesSnapshotListTestJSON-2085903411 None] Create snapshot completed successfully
Jul 04 00:06:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-32e9a328-db62-436f-9205-46929eb398ea tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-32e9a328-db62-436f-9205-46929eb398ea tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-32e9a328-db62-436f-9205-46929eb398ea tempest-VolumesSnapshotListTestJSON-2085903411 None] Creating offline snapshot 0bd182c7-7ffe-4b20-890f-5bc31356cdde of volume 93bd0359-4046-42d3-96fb-9062b18123d3 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:06:08 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[616796d3-ec76-40dd-81db-db0b8656be82]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-32e9a328-db62-436f-9205-46929eb398ea tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:08 devstack sudo[100072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6
Jul 04 00:06:08 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:09 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-32e9a328-db62-436f-9205-46929eb398ea tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6" returned: 0 in 0.922s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-32e9a328-db62-436f-9205-46929eb398ea tempest-VolumesSnapshotListTestJSON-2085903411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93bd0359-4046-42d3-96fb-9062b18123d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:06:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-32e9a328-db62-436f-9205-46929eb398ea tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:09 devstack sudo[100079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde 1G
Jul 04 00:06:09 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:10 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-32e9a328-db62-436f-9205-46929eb398ea tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde 1G" returned: 0 in 0.957s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-32e9a328-db62-436f-9205-46929eb398ea tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:10 devstack sudo[100085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde
Jul 04 00:06:10 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:10 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-32e9a328-db62-436f-9205-46929eb398ea tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde" returned: 0 in 0.740s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:10 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-32e9a328-db62-436f-9205-46929eb398ea tempest-VolumesSnapshotListTestJSON-2085903411 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde is being set with open permissions: ugo+rw
Jul 04 00:06:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-32e9a328-db62-436f-9205-46929eb398ea tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:10 devstack sudo[100090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde
Jul 04 00:06:10 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:11 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-32e9a328-db62-436f-9205-46929eb398ea tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde" returned: 0 in 0.637s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-32e9a328-db62-436f-9205-46929eb398ea tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.375s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:11 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-32e9a328-db62-436f-9205-46929eb398ea tempest-VolumesSnapshotListTestJSON-2085903411 None] Create snapshot completed successfully
Jul 04 00:06:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "cinder-0bd182c7-7ffe-4b20-890f-5bc31356cdde-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-0bd182c7-7ffe-4b20-890f-5bc31356cdde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "cinder-quobyte-93bd0359-4046-42d3-96fb-9062b18123d3" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-quobyte-93bd0359-4046-42d3-96fb-9062b18123d3" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "cinder-quobyte-0bd182c7-7ffe-4b20-890f-5bc31356cdde" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-quobyte-0bd182c7-7ffe-4b20-890f-5bc31356cdde" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Deleting offline snapshot 0bd182c7-7ffe-4b20-890f-5bc31356cdde of volume 93bd0359-4046-42d3-96fb-9062b18123d3 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:06:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] snapshot_file for this snap is: volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:06:13 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fe1ce3-de22-420e-94b0-5a3c87d8e913]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:13 devstack sudo[100093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde
Jul 04 00:06:13 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:14 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde" returned: 0 in 0.819s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93bd0359-4046-42d3-96fb-9062b18123d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:06:14 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba772da-a2d9-40fa-8cf9-adc3ef640d5e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:14 devstack sudo[100100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6
Jul 04 00:06:14 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:06:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:06:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:06:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:14 devstack sudo[100102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:06:14 devstack sudo[100102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:14 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6" returned: 0 in 0.822s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93bd0359-4046-42d3-96fb-9062b18123d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:06:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:14 devstack sudo[100108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde
Jul 04 00:06:14 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:15 devstack sudo[100102]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.670s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:06:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:06:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:06:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:06:15 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde" returned: 0 in 0.878s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:15 devstack sudo[100122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde
Jul 04 00:06:15 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:16 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0bd182c7-7ffe-4b20-890f-5bc31356cdde" returned: 0 in 0.624s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-quobyte-0bd182c7-7ffe-4b20-890f-5bc31356cdde" released by "_delete_snapshot" :: held 3.260s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-quobyte-93bd0359-4046-42d3-96fb-9062b18123d3" released by "delete_snapshot" :: held 3.288s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:16 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Created reservations ['de93a1a9-1315-4e1e-9773-850a2dce7c06', 'd2534d4a-2f8c-4699-99c1-19e241741ade', '2b9e9c7c-fbde-4f72-968d-35c6e06ea67b', 'aea79f0c-e646-470b-982f-8757230d39f4'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:06:16 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Delete snapshot completed successfully.
Jul 04 00:06:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c44efb2b-0cb2-480b-b7da-7efd8af1204f tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-0bd182c7-7ffe-4b20-890f-5bc31356cdde-delete_snapshot" released by "delete_snapshot" :: held 3.431s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "cinder-08c8a5d9-50ae-4b78-8d74-b15c0733a7d6-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-08c8a5d9-50ae-4b78-8d74-b15c0733a7d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "cinder-quobyte-93bd0359-4046-42d3-96fb-9062b18123d3" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-quobyte-93bd0359-4046-42d3-96fb-9062b18123d3" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "cinder-quobyte-08c8a5d9-50ae-4b78-8d74-b15c0733a7d6" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-quobyte-08c8a5d9-50ae-4b78-8d74-b15c0733a7d6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:17 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Deleting offline snapshot 08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 of volume 93bd0359-4046-42d3-96fb-9062b18123d3 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:06:17 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] snapshot_file for this snap is: volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:06:17 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6b3abd-17a1-422f-8d7a-111794b8173e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:17 devstack sudo[100125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6
Jul 04 00:06:17 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:18 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6" returned: 0 in 0.892s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93bd0359-4046-42d3-96fb-9062b18123d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:06:18 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1756a417-e70f-452e-8d63-96bf1987b8dd]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:18 devstack sudo[100130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d
Jul 04 00:06:18 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:19 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d" returned: 0 in 0.929s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93bd0359-4046-42d3-96fb-9062b18123d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:06:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:19 devstack sudo[100135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6
Jul 04 00:06:19 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:20 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6" returned: 0 in 0.786s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:20 devstack sudo[100140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6
Jul 04 00:06:20 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:20 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.08c8a5d9-50ae-4b78-8d74-b15c0733a7d6" returned: 0 in 0.641s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-quobyte-08c8a5d9-50ae-4b78-8d74-b15c0733a7d6" released by "_delete_snapshot" :: held 3.365s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-quobyte-93bd0359-4046-42d3-96fb-9062b18123d3" released by "delete_snapshot" :: held 3.391s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:20 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=48,cinder:UPDATE=46,cinder:DELETE=7,cinder:INSERT=9 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:06:20 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Created reservations ['bcaa6e6b-d1d5-44ec-a38a-3de393e73fb6', '56ee9e96-2465-4e28-b94b-be4cf3ec780d', '92557d02-7cb2-4827-92ac-24b8ad1aff09', '59197354-3889-4e16-857d-1305e1e6109d'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:06:21 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Delete snapshot completed successfully.
Jul 04 00:06:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2ed75854-4c15-4b25-bd54-559bed4b5984 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-08c8a5d9-50ae-4b78-8d74-b15c0733a7d6-delete_snapshot" released by "delete_snapshot" :: held 3.558s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "cinder-0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "cinder-quobyte-93bd0359-4046-42d3-96fb-9062b18123d3" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-quobyte-93bd0359-4046-42d3-96fb-9062b18123d3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "cinder-quobyte-0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-quobyte-0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Deleting offline snapshot 0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d of volume 93bd0359-4046-42d3-96fb-9062b18123d3 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:06:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] snapshot_file for this snap is: volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:06:21 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91a7303-f536-4854-9541-27181d7ea70e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:21 devstack sudo[100157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d
Jul 04 00:06:21 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:22 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d" returned: 0 in 0.838s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93bd0359-4046-42d3-96fb-9062b18123d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:06:22 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[14197a9c-f4b4-4c62-8af0-5cf5e78f6c22]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:22 devstack sudo[100162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3
Jul 04 00:06:22 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:23 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3" returned: 0 in 0.783s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:23 devstack sudo[100167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d
Jul 04 00:06:23 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:24 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d" returned: 0 in 0.860s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:24 devstack sudo[100173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d
Jul 04 00:06:24 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:24 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3.0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d" returned: 0 in 0.665s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-quobyte-0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d" released by "_delete_snapshot" :: held 3.248s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:25 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-quobyte-93bd0359-4046-42d3-96fb-9062b18123d3" released by "delete_snapshot" :: held 3.272s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:25 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Created reservations ['794c6921-9995-45f6-b0dc-c496380d2ea5', 'cda8f54d-7a63-4396-b39c-1159cace98fa', '8c2fa634-a141-4ec4-871f-6b56f003e78a', '76ce61c0-7c77-45de-bb66-6326bac2ba7d'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:06:25 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Delete snapshot completed successfully.
Jul 04 00:06:25 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d89bed3-02d2-4cac-b965-3fc2c7979a78 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-0d07464f-2a60-4f8f-8b06-fd42fd6b5d9d-delete_snapshot" released by "delete_snapshot" :: held 3.403s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "cinder-93bd0359-4046-42d3-96fb-9062b18123d3-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-93bd0359-4046-42d3-96fb-9062b18123d3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "cinder-quobyte-93bd0359-4046-42d3-96fb-9062b18123d3" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-quobyte-93bd0359-4046-42d3-96fb-9062b18123d3" acquired by "delete_volume" :: waited 0.014s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:26 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2015c9-0dc0-4d80-afd8-6d9d972e0a5d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:26 devstack sudo[100178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3
Jul 04 00:06:26 devstack sudo[100178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:26 devstack sudo[100178]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3" returned: 0 in 0.765s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:26 devstack sudo[100183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3
Jul 04 00:06:26 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:27 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-93bd0359-4046-42d3-96fb-9062b18123d3" returned: 0 in 0.649s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-quobyte-93bd0359-4046-42d3-96fb-9062b18123d3" released by "delete_volume" :: held 1.471s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:27 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Created reservations ['64b1adae-9995-4c60-b72d-71928aa165ee', '1895360e-a5e7-4e9b-b374-463e063fd763', '1c40873d-f518-430e-a2e7-deda20cfbafb', '50bf1eca-17c9-4bf3-a7c8-28ebd3095f2a'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:06:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:06:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:06:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:27 devstack sudo[100186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:06:27 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:28 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.756s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:28 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:06:28 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Deleted volume successfully.
Jul 04 00:06:28 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7eb244ae-358e-432b-8c11-64d2b0f64e04 tempest-VolumesSnapshotListTestJSON-2085903411 None] Lock "cinder-93bd0359-4046-42d3-96fb-9062b18123d3-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Flow 'volume_create_manager' (06b82685-8f47-43c3-8ae0-71a3636f60cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ada6e93-9ea8-4e44-9beb-53ac0d3eaf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ada6e93-9ea8-4e44-9beb-53ac0d3eaf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-442582087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0e4812-e4b2-49bd-add2-ef4560cbfd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da243b0b4fa48fab2997833c0b97129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:06:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:06:32Z,use_quota=True,user_id='ce22395e136f49f9b876530a0dfb1ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e45b7a-ef37-44f2-acdc-1ad7513cb567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e45b7a-ef37-44f2-acdc-1ad7513cb567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3186fb8-9bbb-415e-bea5-1730c3a2d774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3186fb8-9bbb-415e-bea5-1730c3a2d774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be0e4812-e4b2-49bd-add2-ef4560cbfd7e', 'volume_name': 'volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e', 'volume_size': 2}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb14b86-ec35-4c84-9ffd-7e1026ecfd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb14b86-ec35-4c84-9ffd-7e1026ecfd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a98462-7141-44fd-b771-08bac66097e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:31 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Volume be0e4812-e4b2-49bd-add2-ef4560cbfd7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e', 'volume_size': 2}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-442582087',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be0e4812-e4b2-49bd-add2-ef4560cbfd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7da243b0b4fa48fab2997833c0b97129',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:06:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:06:32Z,use_quota=True,user_id='ce22395e136f49f9b876530a0dfb1ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Creating volume be0e4812-e4b2-49bd-add2-ef4560cbfd7e {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:06:31 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:06:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e 2147483648 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:31 devstack sudo[100197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e 2147483648
Jul 04 00:06:31 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:32 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e 2147483648" returned: 0 in 0.940s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:32 devstack sudo[100207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e
Jul 04 00:06:32 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:32 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-9856012e-2d9d-44ee-b5f6-b2bb8728470e req-024cc2ed-b846-4f15-a921-0e64b8f047df tempest-TestMinimumBasicScenario-1651554483 None] Terminate volume connection completed successfully.
Jul 04 00:06:32 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-9856012e-2d9d-44ee-b5f6-b2bb8728470e req-024cc2ed-b846-4f15-a921-0e64b8f047df tempest-TestMinimumBasicScenario-1651554483 None] Deleting attachment 973b1508-ff4c-4834-82ca-40d296b9bba4. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:06:33 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e" returned: 0 in 0.698s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:06:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a98462-7141-44fd-b771-08bac66097e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e', 'volume_size': 2}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa94dd7-546f-4103-884a-c665f2aa4624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:06:33 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Volume volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e (be0e4812-e4b2-49bd-add2-ef4560cbfd7e): created successfully
Jul 04 00:06:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa94dd7-546f-4103-884a-c665f2aa4624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:06:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Flow 'volume_create_manager' (06b82685-8f47-43c3-8ae0-71a3636f60cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:06:33 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-2028229e-0048-4ebe-93d9-d82c892cfcda tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Created volume successfully.
Jul 04 00:06:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Creating offline snapshot e90a8d0f-2992-4409-b304-51e52d8be290 of volume be0e4812-e4b2-49bd-add2-ef4560cbfd7e {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:06:34 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2e4e31-0d6e-49b1-9979-c13259b3100a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:34 devstack sudo[100211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e
Jul 04 00:06:34 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:34 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e" returned: 0 in 0.878s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290 2G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:34 devstack sudo[100216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290 2G
Jul 04 00:06:34 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Acquiring lock "cinder-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Lock "cinder-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Acquiring lock "cinder-quobyte-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Lock "cinder-quobyte-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:35 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e838f19-9e5f-4ea6-a524-f1a4d989c19c]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:35 devstack sudo[100218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb
Jul 04 00:06:35 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:35 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290 2G" returned: 0 in 0.894s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:35 devstack sudo[100227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290
Jul 04 00:06:35 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:35 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb" returned: 0 in 0.841s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:35 devstack sudo[100229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb
Jul 04 00:06:35 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:36 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290" returned: 0 in 0.773s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:36 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290 is being set with open permissions: ugo+rw
Jul 04 00:06:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:36 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:36 devstack sudo[100235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290
Jul 04 00:06:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb" returned: 0 in 0.685s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:36 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Lock "cinder-quobyte-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb" released by "delete_volume" :: held 1.565s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:36 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Created reservations ['0dac1792-4f4c-4283-bc2a-737bca4b9fdd', '646816e9-c81f-4587-adc1-9a803bc26e8c', 'e45f98ed-141a-47e7-bbee-c8eee8fcb642', 'c61e4a04-47e4-48ce-afe7-f6685bae4fe1'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:06:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:06:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:06:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:36 devstack sudo[100237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:06:36 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:37 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290" returned: 0 in 0.676s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:37 devstack sudo[100240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.info
Jul 04 00:06:37 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:37 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.723s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:37 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:06:37 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Deleted volume successfully.
Jul 04 00:06:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3c346f83-40e5-48e5-b958-2d8d55a1e847 tempest-TestMinimumBasicScenario-1651554483 None] Lock "cinder-5e0328e9-fb00-4cdf-bcee-305c79e3f7eb-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:38 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.info" returned: 0 in 0.727s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:38 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.info is being set with open permissions: ugo+rw
Jul 04 00:06:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:38 devstack sudo[100244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.info
Jul 04 00:06:38 devstack sudo[100244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:38 devstack sudo[100244]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.info" returned: 0 in 0.716s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.773s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:38 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6f8c44c0-f316-4eb6-b2e4-2d5185fbd004 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Create snapshot completed successfully
Jul 04 00:06:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Acquiring lock "cinder-e90a8d0f-2992-4409-b304-51e52d8be290-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "cinder-e90a8d0f-2992-4409-b304-51e52d8be290-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Acquiring lock "cinder-quobyte-be0e4812-e4b2-49bd-add2-ef4560cbfd7e" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "cinder-quobyte-be0e4812-e4b2-49bd-add2-ef4560cbfd7e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Acquiring lock "cinder-quobyte-e90a8d0f-2992-4409-b304-51e52d8be290" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "cinder-quobyte-e90a8d0f-2992-4409-b304-51e52d8be290" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:39 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Deleting offline snapshot e90a8d0f-2992-4409-b304-51e52d8be290 of volume be0e4812-e4b2-49bd-add2-ef4560cbfd7e {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:06:39 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] snapshot_file for this snap is: volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:06:39 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca3dcba-7943-467a-9c9f-31630549efa2]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:39 devstack sudo[100270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290
Jul 04 00:06:39 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:40 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290" returned: 0 in 0.877s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:06:40 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e25f89-71b2-4c53-b440-bacdaac5936b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:40 devstack sudo[100278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e
Jul 04 00:06:40 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:41 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e" returned: 0 in 0.785s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:41 devstack sudo[100283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290
Jul 04 00:06:41 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:41 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290" returned: 0 in 0.759s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:42 devstack sudo[100288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290
Jul 04 00:06:42 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:42 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e.e90a8d0f-2992-4409-b304-51e52d8be290" returned: 0 in 0.710s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "cinder-quobyte-e90a8d0f-2992-4409-b304-51e52d8be290" released by "_delete_snapshot" :: held 3.242s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "cinder-quobyte-be0e4812-e4b2-49bd-add2-ef4560cbfd7e" released by "delete_snapshot" :: held 3.273s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:42 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:INSERT=22,cinder:UPDATE=74,cinder:SELECT=75,cinder:DELETE=5 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:06:42 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Created reservations ['d5fcf852-ef9f-48da-a917-33be0096ed04', '314f10cb-3782-4e3d-9356-914a03a44a18', '5b00f22b-eac8-4136-a718-1b34eeda6263', '1e77a28c-886a-4828-a1ff-566947f7da49'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:06:42 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Delete snapshot completed successfully.
Jul 04 00:06:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-279091f8-10cc-4222-9fff-b1df245f57bc tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "cinder-e90a8d0f-2992-4409-b304-51e52d8be290-delete_snapshot" released by "delete_snapshot" :: held 3.440s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Acquiring lock "cinder-be0e4812-e4b2-49bd-add2-ef4560cbfd7e-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "cinder-be0e4812-e4b2-49bd-add2-ef4560cbfd7e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Acquiring lock "cinder-quobyte-be0e4812-e4b2-49bd-add2-ef4560cbfd7e" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:06:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "cinder-quobyte-be0e4812-e4b2-49bd-add2-ef4560cbfd7e" acquired by "delete_volume" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:06:43 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67362e4-3b30-493f-b6fc-39bbda07d698]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:06:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:44 devstack sudo[100292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e
Jul 04 00:06:44 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:44 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e" returned: 0 in 0.796s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:44 devstack sudo[100297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e
Jul 04 00:06:44 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:45 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-be0e4812-e4b2-49bd-add2-ef4560cbfd7e" returned: 0 in 0.733s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "cinder-quobyte-be0e4812-e4b2-49bd-add2-ef4560cbfd7e" released by "delete_volume" :: held 1.596s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:45 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Created reservations ['05bcb1c1-5c4d-4b17-8b2b-ff4bca58f920', '68a9e9e7-4c9f-4e43-9847-9497f8f1631d', 'ff613c30-8d9a-4ce2-8c21-65d41fb0756d', '4145bd83-b1fa-4441-9834-7cfd48e2b109'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:06:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:06:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:06:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:06:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:06:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:06:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:06:45 devstack sudo[100300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:06:45 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:06:46 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root
Jul 04 00:06:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.846s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:06:46 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:06:46 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Deleted volume successfully.
Jul 04 00:06:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2770e925-2fa4-43b3-9694-e4f5c9817b47 tempest-VolumesSnapshotNegativeTestJSON-750405508 None] Lock "cinder-be0e4812-e4b2-49bd-add2-ef4560cbfd7e-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:06:55 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:INSERT=14,cinder:UPDATE=46,cinder:SELECT=34,cinder:DELETE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:06:56 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:INSERT=4,cinder:UPDATE=13,cinder:SELECT=7,cinder:DELETE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:07:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:07:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:07:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:07:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:14 devstack sudo[100369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:07:14 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:15 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.768s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:07:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:07:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:07:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Flow 'volume_create_manager' (fcd71e7a-7d04-4d47-b363-65b6de35fa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efebe5d7-de01-4afd-9776-875d20818d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efebe5d7-de01-4afd-9776-875d20818d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-75204682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e1df58-d85b-4970-8b0e-1d751565a428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36de636adf7947309a24956d96ea9bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:20Z,use_quota=True,user_id='2cb7135235d04821a77c21f9594d5990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b3b8f2-48d6-44ec-a474-217cac9e60e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14b3b8f2-48d6-44ec-a474-217cac9e60e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2935150d-c746-40f8-af06-71a3b6485f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2935150d-c746-40f8-af06-71a3b6485f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68e1df58-d85b-4970-8b0e-1d751565a428', 'volume_name': 'volume-68e1df58-d85b-4970-8b0e-1d751565a428', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9147011-9f42-4cc1-83f6-7c5038dddcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9147011-9f42-4cc1-83f6-7c5038dddcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9101402e-2fc6-4d4a-bec6-871b1368c6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:19 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Volume 68e1df58-d85b-4970-8b0e-1d751565a428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68e1df58-d85b-4970-8b0e-1d751565a428', 'volume_size': 1}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-75204682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68e1df58-d85b-4970-8b0e-1d751565a428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36de636adf7947309a24956d96ea9bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:20Z,use_quota=True,user_id='2cb7135235d04821a77c21f9594d5990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Creating volume 68e1df58-d85b-4970-8b0e-1d751565a428 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:07:19 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-68e1df58-d85b-4970-8b0e-1d751565a428 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:19 devstack sudo[100374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-68e1df58-d85b-4970-8b0e-1d751565a428 1073741824
Jul 04 00:07:19 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Flow 'volume_create_manager' (25b2c070-ce68-4e05-886f-751ca24be2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12feb5c-ccd9-476d-ba47-0cc8ff1be0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12feb5c-ccd9-476d-ba47-0cc8ff1be0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-963908065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0940cc2d-8021-40c9-837a-d2b545d50253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36de636adf7947309a24956d96ea9bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:20Z,use_quota=True,user_id='2cb7135235d04821a77c21f9594d5990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af3c90d-3397-44e7-aa83-b627e9bfbfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7af3c90d-3397-44e7-aa83-b627e9bfbfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7247216e-3319-40a4-9440-fd8e571d6c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7247216e-3319-40a4-9440-fd8e571d6c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0940cc2d-8021-40c9-837a-d2b545d50253', 'volume_name': 'volume-0940cc2d-8021-40c9-837a-d2b545d50253', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad4aa18-db30-49a5-a80b-f0c0e7fb3349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad4aa18-db30-49a5-a80b-f0c0e7fb3349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f894d7-618e-40a6-8f96-91488428160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:19 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Volume 0940cc2d-8021-40c9-837a-d2b545d50253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0940cc2d-8021-40c9-837a-d2b545d50253', 'volume_size': 1}
Jul 04 00:07:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:20 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-68e1df58-d85b-4970-8b0e-1d751565a428 1073741824" returned: 0 in 1.095s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-68e1df58-d85b-4970-8b0e-1d751565a428 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:20 devstack sudo[100380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-68e1df58-d85b-4970-8b0e-1d751565a428
Jul 04 00:07:20 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:21 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-68e1df58-d85b-4970-8b0e-1d751565a428" returned: 0 in 0.867s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] <== create_volume: return (2025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.027s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.718s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-963908065',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0940cc2d-8021-40c9-837a-d2b545d50253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36de636adf7947309a24956d96ea9bb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:20Z,use_quota=True,user_id='2cb7135235d04821a77c21f9594d5990',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Creating volume 0940cc2d-8021-40c9-837a-d2b545d50253 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:07:21 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0940cc2d-8021-40c9-837a-d2b545d50253 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:21 devstack sudo[100383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0940cc2d-8021-40c9-837a-d2b545d50253 1073741824
Jul 04 00:07:21 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9101402e-2fc6-4d4a-bec6-871b1368c6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68e1df58-d85b-4970-8b0e-1d751565a428', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adb17a7-adc6-4f1b-9c0f-95a6c36a746e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:21 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Volume volume-68e1df58-d85b-4970-8b0e-1d751565a428 (68e1df58-d85b-4970-8b0e-1d751565a428): created successfully
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9adb17a7-adc6-4f1b-9c0f-95a6c36a746e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Flow 'volume_create_manager' (fcd71e7a-7d04-4d47-b363-65b6de35fa3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:21 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-da08c59e-7c48-4bc6-8c88-1964b4cf0c9c tempest-TestServerVolumeAttachmentScenario-2101757390 None] Created volume successfully.
Jul 04 00:07:23 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0940cc2d-8021-40c9-837a-d2b545d50253 1073741824" returned: 0 in 1.337s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0940cc2d-8021-40c9-837a-d2b545d50253 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:23 devstack sudo[100390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0940cc2d-8021-40c9-837a-d2b545d50253
Jul 04 00:07:23 devstack sudo[100390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:24 devstack sudo[100390]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0940cc2d-8021-40c9-837a-d2b545d50253" returned: 0 in 1.048s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:24 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] <== create_volume: return (2451ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:07:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.454s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0f894d7-618e-40a6-8f96-91488428160e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0940cc2d-8021-40c9-837a-d2b545d50253', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b59323-7a78-44fe-a0a1-b700b3420e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:24 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Volume volume-0940cc2d-8021-40c9-837a-d2b545d50253 (0940cc2d-8021-40c9-837a-d2b545d50253): created successfully
Jul 04 00:07:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b59323-7a78-44fe-a0a1-b700b3420e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Flow 'volume_create_manager' (25b2c070-ce68-4e05-886f-751ca24be2fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:24 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-af45ee8b-12b7-480d-a434-e0261322e702 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Created volume successfully.
Jul 04 00:07:34 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:07:34 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=7,cinder:SELECT=2,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Flow 'volume_create_manager' (5e9ec539-c84e-49dd-a2b4-612ae8194676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5995e47d-31f5-4422-8e79-f5e3947b7273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5995e47d-31f5-4422-8e79-f5e3947b7273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1688496850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a8c72c-2e26-45d1-ad22-e8571bf0a282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='925e5a7e60b94ddca81127bd43439ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:56Z,use_quota=True,user_id='2853da8ecdd84bffb043299f9e9e4e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8153f092-2ee4-4f3e-abf7-d637a391e8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8153f092-2ee4-4f3e-abf7-d637a391e8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39f445f-b402-4c77-a339-39e049aa5d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39f445f-b402-4c77-a339-39e049aa5d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00a8c72c-2e26-45d1-ad22-e8571bf0a282', 'volume_name': 'volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75cbeef3-76ee-438c-8aba-1ecb32b3934e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75cbeef3-76ee-438c-8aba-1ecb32b3934e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944b32fd-515f-4fc7-a40a-80d13d38de4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:55 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Volume 00a8c72c-2e26-45d1-ad22-e8571bf0a282: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282', 'volume_size': 1}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1688496850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a8c72c-2e26-45d1-ad22-e8571bf0a282,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='925e5a7e60b94ddca81127bd43439ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:07:56Z,use_quota=True,user_id='2853da8ecdd84bffb043299f9e9e4e2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Creating volume 00a8c72c-2e26-45d1-ad22-e8571bf0a282 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:07:55 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:07:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:55 devstack sudo[100646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282 1073741824
Jul 04 00:07:55 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:56 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282 1073741824" returned: 0 in 0.895s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:07:56 devstack sudo[100651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282
Jul 04 00:07:56 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:07:57 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root
Jul 04 00:07:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282" returned: 0 in 0.654s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:07:57 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:07:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:07:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944b32fd-515f-4fc7-a40a-80d13d38de4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c82d72-aa98-4992-8887-7a7f64810e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:07:57 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Volume volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282 (00a8c72c-2e26-45d1-ad22-e8571bf0a282): created successfully
Jul 04 00:07:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0c82d72-aa98-4992-8887-7a7f64810e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:07:57 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Flow 'volume_create_manager' (5e9ec539-c84e-49dd-a2b4-612ae8194676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:07:57 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9bbf582d-d222-47e0-833d-5dabc247f7a0 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Created volume successfully.
Jul 04 00:08:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-7c36e6a7-e078-4f8b-8bdc-3d12833bb8a9 req-e864bbb8-526c-4228-96e5-f662c8e4ecf4 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-7c36e6a7-e078-4f8b-8bdc-3d12833bb8a9 req-e864bbb8-526c-4228-96e5-f662c8e4ecf4 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:00 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2551d18b-ba90-4d76-95e1-2d10183616ce]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-7c36e6a7-e078-4f8b-8bdc-3d12833bb8a9 req-e864bbb8-526c-4228-96e5-f662c8e4ecf4 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:01 devstack sudo[100676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282
Jul 04 00:08:01 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:01 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-7c36e6a7-e078-4f8b-8bdc-3d12833bb8a9 req-e864bbb8-526c-4228-96e5-f662c8e4ecf4 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282" returned: 0 in 0.799s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-7c36e6a7-e078-4f8b-8bdc-3d12833bb8a9 req-e864bbb8-526c-4228-96e5-f662c8e4ecf4 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.819s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-7c36e6a7-e078-4f8b-8bdc-3d12833bb8a9 req-e864bbb8-526c-4228-96e5-f662c8e4ecf4 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77afa031-24e2-4ea2-8d68-a6d67233721f', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:08:01 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-7c36e6a7-e078-4f8b-8bdc-3d12833bb8a9 req-e864bbb8-526c-4228-96e5-f662c8e4ecf4 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] attachment_update completed successfully.
Jul 04 00:08:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-a28fb09c-7991-42c4-b286-e0b61b7785c0 req-a8fe938f-c006-47ba-a279-b5929c011374 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-a28fb09c-7991-42c4-b286-e0b61b7785c0 req-a8fe938f-c006-47ba-a279-b5929c011374 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:02 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1019258e-8094-42b5-a494-19a4e7318a7b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-a28fb09c-7991-42c4-b286-e0b61b7785c0 req-a8fe938f-c006-47ba-a279-b5929c011374 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-68e1df58-d85b-4970-8b0e-1d751565a428 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:03 devstack sudo[101071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-68e1df58-d85b-4970-8b0e-1d751565a428
Jul 04 00:08:03 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:03 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-a28fb09c-7991-42c4-b286-e0b61b7785c0 req-a8fe938f-c006-47ba-a279-b5929c011374 tempest-TestServerVolumeAttachmentScenario-2101757390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-68e1df58-d85b-4970-8b0e-1d751565a428" returned: 0 in 0.782s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-a28fb09c-7991-42c4-b286-e0b61b7785c0 req-a8fe938f-c006-47ba-a279-b5929c011374 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.800s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-a28fb09c-7991-42c4-b286-e0b61b7785c0 req-a8fe938f-c006-47ba-a279-b5929c011374 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-68e1df58-d85b-4970-8b0e-1d751565a428', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'adeb5896-8eee-40c7-9cde-759b4a319e41', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:08:03 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-a28fb09c-7991-42c4-b286-e0b61b7785c0 req-a8fe938f-c006-47ba-a279-b5929c011374 tempest-TestServerVolumeAttachmentScenario-2101757390 None] attachment_update completed successfully.
Jul 04 00:08:08 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-6e3d47c1-95d4-4ec9-a0ba-797570d0b97b req-98ea9993-a058-4a45-88a1-26ee8f29e6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Terminate volume connection completed successfully.
Jul 04 00:08:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-6e3d47c1-95d4-4ec9-a0ba-797570d0b97b req-98ea9993-a058-4a45-88a1-26ee8f29e6e3 tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Deleting attachment 77afa031-24e2-4ea2-8d68-a6d67233721f. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:08:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Acquiring lock "cinder-00a8c72c-2e26-45d1-ad22-e8571bf0a282-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Lock "cinder-00a8c72c-2e26-45d1-ad22-e8571bf0a282-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Acquiring lock "cinder-quobyte-00a8c72c-2e26-45d1-ad22-e8571bf0a282" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Lock "cinder-quobyte-00a8c72c-2e26-45d1-ad22-e8571bf0a282" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:10 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc99ea56-1177-462f-8e28-0756b7635030]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:10 devstack sudo[101084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282
Jul 04 00:08:10 devstack sudo[101084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:10 devstack sudo[101084]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282" returned: 0 in 0.729s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:10 devstack sudo[101089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282
Jul 04 00:08:10 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:11 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-00a8c72c-2e26-45d1-ad22-e8571bf0a282" returned: 0 in 0.640s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Lock "cinder-quobyte-00a8c72c-2e26-45d1-ad22-e8571bf0a282" released by "delete_volume" :: held 1.407s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:11 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Created reservations ['26c06c8a-7d1d-4fa3-be28-d174559b10f0', 'f60f0095-3e10-4396-8a5c-106ab9964bf3', '1c1b717e-9747-4f02-81f1-7e29c2588b7e', '07732890-9525-4c2d-8f6a-4389152ad38a'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:11 devstack sudo[101092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:08:11 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:12 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.683s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:12 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:12 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Deleted volume successfully.
Jul 04 00:08:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f2db04c7-4765-4fb1-a442-00af6a20cadc tempest-TestServerVolumeAttachScenarioOldVersion-1552362207 None] Lock "cinder-00a8c72c-2e26-45d1-ad22-e8571bf0a282-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-fd4dcb00-46aa-41b8-9b60-2c29c127d1ff req-28aa6b90-c2be-4b79-a4ef-b84b0f58aeb5 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-fd4dcb00-46aa-41b8-9b60-2c29c127d1ff req-28aa6b90-c2be-4b79-a4ef-b84b0f58aeb5 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:12 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[081fec0d-ecee-47b8-bd65-c65d30c49182]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-fd4dcb00-46aa-41b8-9b60-2c29c127d1ff req-28aa6b90-c2be-4b79-a4ef-b84b0f58aeb5 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0940cc2d-8021-40c9-837a-d2b545d50253 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:12 devstack sudo[101103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0940cc2d-8021-40c9-837a-d2b545d50253
Jul 04 00:08:12 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:13 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-fd4dcb00-46aa-41b8-9b60-2c29c127d1ff req-28aa6b90-c2be-4b79-a4ef-b84b0f58aeb5 tempest-TestServerVolumeAttachmentScenario-2101757390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0940cc2d-8021-40c9-837a-d2b545d50253" returned: 0 in 0.787s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-fd4dcb00-46aa-41b8-9b60-2c29c127d1ff req-28aa6b90-c2be-4b79-a4ef-b84b0f58aeb5 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.806s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-fd4dcb00-46aa-41b8-9b60-2c29c127d1ff req-28aa6b90-c2be-4b79-a4ef-b84b0f58aeb5 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-0940cc2d-8021-40c9-837a-d2b545d50253', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4fdab8b6-f8ba-42c8-a5d8-089dfd9f1a21', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:08:13 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-fd4dcb00-46aa-41b8-9b60-2c29c127d1ff req-28aa6b90-c2be-4b79-a4ef-b84b0f58aeb5 tempest-TestServerVolumeAttachmentScenario-2101757390 None] attachment_update completed successfully.
Jul 04 00:08:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:08:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:14 devstack sudo[101128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:08:14 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:15 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.861s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:08:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:08:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:08:19 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-da9a32bc-446c-43af-97b8-dc1f04f0a6cb req-7b29e992-2077-4cdf-88c1-8b9005d6d7a0 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Terminate volume connection completed successfully.
Jul 04 00:08:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-da9a32bc-446c-43af-97b8-dc1f04f0a6cb req-7b29e992-2077-4cdf-88c1-8b9005d6d7a0 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Deleting attachment 4fdab8b6-f8ba-42c8-a5d8-089dfd9f1a21. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:08:23 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-59b708ae-4db3-420c-831e-591ac881666f req-3ab619e4-e02b-4ce8-a18f-084f0500299e tempest-TestServerVolumeAttachmentScenario-2101757390 None] Terminate volume connection completed successfully.
Jul 04 00:08:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-59b708ae-4db3-420c-831e-591ac881666f req-3ab619e4-e02b-4ce8-a18f-084f0500299e tempest-TestServerVolumeAttachmentScenario-2101757390 None] Deleting attachment adeb5896-8eee-40c7-9cde-759b4a319e41. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:08:33 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=15,cinder:SELECT=21,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:08:33 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=33,cinder:UPDATE=17,cinder:INSERT=3 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:08:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Acquiring lock "cinder-0940cc2d-8021-40c9-837a-d2b545d50253-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "cinder-0940cc2d-8021-40c9-837a-d2b545d50253-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Acquiring lock "cinder-quobyte-0940cc2d-8021-40c9-837a-d2b545d50253" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "cinder-quobyte-0940cc2d-8021-40c9-837a-d2b545d50253" acquired by "delete_volume" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:34 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1839d6ce-69dc-4b0a-aa47-c73cbf6be05f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0940cc2d-8021-40c9-837a-d2b545d50253 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:34 devstack sudo[101207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0940cc2d-8021-40c9-837a-d2b545d50253
Jul 04 00:08:34 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:35 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0940cc2d-8021-40c9-837a-d2b545d50253" returned: 0 in 0.863s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0940cc2d-8021-40c9-837a-d2b545d50253 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:35 devstack sudo[101212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0940cc2d-8021-40c9-837a-d2b545d50253
Jul 04 00:08:35 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:36 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0940cc2d-8021-40c9-837a-d2b545d50253" returned: 0 in 0.719s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "cinder-quobyte-0940cc2d-8021-40c9-837a-d2b545d50253" released by "delete_volume" :: held 1.661s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:36 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Created reservations ['fcf62be0-955b-4e99-bdfc-898e49cf68aa', 'fda30081-5e1e-40fd-b0ee-6ab68a387790', '7917928b-7a2f-4b69-98ca-353bafdf7e44', '0c3597a1-a5dc-48f0-9340-524a0424fdb1'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:36 devstack sudo[101216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:08:36 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Acquiring lock "cinder-68e1df58-d85b-4970-8b0e-1d751565a428-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "cinder-68e1df58-d85b-4970-8b0e-1d751565a428-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Acquiring lock "cinder-quobyte-68e1df58-d85b-4970-8b0e-1d751565a428" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:08:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "cinder-quobyte-68e1df58-d85b-4970-8b0e-1d751565a428" acquired by "delete_volume" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:08:36 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[59511082-5e6d-4b97-a45c-60be2c6d7fdf]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-68e1df58-d85b-4970-8b0e-1d751565a428 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:36 devstack sudo[101218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-68e1df58-d85b-4970-8b0e-1d751565a428
Jul 04 00:08:36 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:37 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.787s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:37 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:37 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Deleted volume successfully.
Jul 04 00:08:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0aaf03fb-58a4-46fc-b2f6-a07f7e67c89b tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "cinder-0940cc2d-8021-40c9-837a-d2b545d50253-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:37 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-68e1df58-d85b-4970-8b0e-1d751565a428" returned: 0 in 0.822s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-68e1df58-d85b-4970-8b0e-1d751565a428 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:37 devstack sudo[101224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-68e1df58-d85b-4970-8b0e-1d751565a428
Jul 04 00:08:37 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:38 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-68e1df58-d85b-4970-8b0e-1d751565a428" returned: 0 in 0.754s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "cinder-quobyte-68e1df58-d85b-4970-8b0e-1d751565a428" released by "delete_volume" :: held 1.633s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:38 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Created reservations ['431ed39b-3ef7-483c-801c-13acc5278683', '8379bde2-4628-479f-ad06-ec0db6f8fe9a', 'daacedce-803a-4d5b-a56a-5424e2608a6f', '183ba80a-4ac7-48f6-9b7c-46be8a93dc66'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:08:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:38 devstack sudo[101229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:08:38 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:39 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.796s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:39 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:08:39 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Deleted volume successfully.
Jul 04 00:08:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4a62b846-338e-4406-9785-b9e12810f439 tempest-TestServerVolumeAttachmentScenario-2101757390 None] Lock "cinder-68e1df58-d85b-4970-8b0e-1d751565a428-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:08:48 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=18,cinder:SELECT=9,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:08:49 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=11,cinder:UPDATE=14,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Flow 'volume_create_manager' (ba61bcae-9f5b-42b2-893e-5e2a903fcbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec726d0-3da2-4ae3-8b22-ce044628101e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec726d0-3da2-4ae3-8b22-ce044628101e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1184499734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc16fa3f-ff5f-440f-b0a5-7d0616d237a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='858c19973731447eba4028bd55ba9938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:53Z,use_quota=True,user_id='04de1fa664894f35be63bbfd0c6db740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d8718c-f922-4ee4-ac00-6a8955efbe5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d8718c-f922-4ee4-ac00-6a8955efbe5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93fdfe1-ce04-41e1-9ad6-b18873e317cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93fdfe1-ce04-41e1-9ad6-b18873e317cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc16fa3f-ff5f-440f-b0a5-7d0616d237a0', 'volume_name': 'volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce2a0d4-167d-4cf8-9ab7-f81999a799a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce2a0d4-167d-4cf8-9ab7-f81999a799a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47be53a7-a170-4d41-9824-252c7c037c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:53 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Volume fc16fa3f-ff5f-440f-b0a5-7d0616d237a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0', 'volume_size': 1}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1184499734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc16fa3f-ff5f-440f-b0a5-7d0616d237a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='858c19973731447eba4028bd55ba9938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:53Z,use_quota=True,user_id='04de1fa664894f35be63bbfd0c6db740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Creating volume fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:08:53 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:08:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:53 devstack sudo[101274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 1073741824
Jul 04 00:08:53 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 1073741824" returned: 0 in 0.931s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:54 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:54 devstack sudo[101281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0
Jul 04 00:08:54 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:54 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0" returned: 0 in 0.808s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:08:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:08:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47be53a7-a170-4d41-9824-252c7c037c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105ec1ea-b359-47cc-9eae-54ec410a7d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:55 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Volume volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 (fc16fa3f-ff5f-440f-b0a5-7d0616d237a0): created successfully
Jul 04 00:08:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105ec1ea-b359-47cc-9eae-54ec410a7d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Flow 'volume_create_manager' (ba61bcae-9f5b-42b2-893e-5e2a903fcbc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:55 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-2caadbd9-9e36-49e4-83d4-95609e7020fd tempest-VolumeDependencyTests-528073734 None] Created volume successfully.
Jul 04 00:08:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:08:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:08:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] Creating offline snapshot 06707a4d-5ae5-4465-9278-2319fbf94f2f of volume fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:08:55 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdcb87a-2b5e-4c0b-aea2-28e31e1d2a47]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:55 devstack sudo[101284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0
Jul 04 00:08:55 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:56 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0" returned: 0 in 0.786s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:56 devstack sudo[101289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f 1G
Jul 04 00:08:56 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:57 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f 1G" returned: 0 in 0.971s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:57 devstack sudo[101301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f
Jul 04 00:08:57 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:57 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f" returned: 0 in 0.736s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:57 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f is being set with open permissions: ugo+rw
Jul 04 00:08:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:57 devstack sudo[101308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f
Jul 04 00:08:57 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:58 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f" returned: 0 in 0.687s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:58 devstack sudo[101311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.info
Jul 04 00:08:58 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:58 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:08:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Flow 'volume_create_manager' (cdf63ff1-b664-4baa-9f28-c03421bf61a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:08:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982fbcde-4dfb-4732-8e1b-a570acedf554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (982fbcde-4dfb-4732-8e1b-a570acedf554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-47757246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3739af74-e602-49e4-81f5-f22edc56b579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53035170bc86499a98f856ee6de94261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:59Z,use_quota=True,user_id='e5896d2fec3743bfb75db97757fc6b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1930fbfa-678d-4408-a200-e915ab37b84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1930fbfa-678d-4408-a200-e915ab37b84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8fb5ea8-20dc-4dfd-a31e-2cd420d6bf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:58 devstack cinder-volume[86650]: DEBUG cinder.image.glance [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Creating Keystone auth plugin from conf {{(pid=86650) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 04 00:08:59 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root
Jul 04 00:08:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.info" returned: 0 in 0.693s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:08:59 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.info is being set with open permissions: ugo+rw
Jul 04 00:08:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:08:59 devstack sudo[101314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.info
Jul 04 00:08:59 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:08:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8fb5ea8-20dc-4dfd-a31e-2cd420d6bf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3739af74-e602-49e4-81f5-f22edc56b579', 'volume_name': 'volume-3739af74-e602-49e4-81f5-f22edc56b579', 'volume_size': 1, 'image_id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee7f20f7f01043bc91ea80a8d5f6c3f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'created_at': datetime.datetime(2026, 7, 3, 21, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 43, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000b75100>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449b6a6b-62a4-4557-b347-641fbbf6e76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449b6a6b-62a4-4557-b347-641fbbf6e76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:08:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daed748d-6dd6-4bfb-be19-031c9ce122dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:08:59 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Volume 3739af74-e602-49e4-81f5-f22edc56b579: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3739af74-e602-49e4-81f5-f22edc56b579', 'volume_size': 1, 'image_id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee7f20f7f01043bc91ea80a8d5f6c3f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'created_at': datetime.datetime(2026, 7, 3, 21, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 43, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000b75100>}
Jul 04 00:08:59 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Trying to clone 3739af74-e602-49e4-81f5-f22edc56b579 from image b8f0cc76-877f-40ea-bce4-db07a2ff6489 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}]). {{(pid=86650) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 04 00:08:59 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_0vdoqakqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 04 00:08:59 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Image download 20.69 MB at 20.69 MB/s
Jul 04 00:08:59 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce83ff9-72ac-47a9-84f5-823b7cf30f54]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:08:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_0vdoqakqdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:00 devstack sudo[101317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_0vdoqakqdevstack@QuobyteHD
Jul 04 00:09:00 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:00 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.info" returned: 0 in 0.721s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.687s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:00 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ed018ce0-2540-4283-9f6b-9bbc38943035 tempest-VolumeDependencyTests-528073734 None] Create snapshot completed successfully
Jul 04 00:09:00 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_0vdoqakqdevstack@QuobyteHD" returned: 0 in 0.768s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:00 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Temporary image b8f0cc76-877f-40ea-bce4-db07a2ff6489 is fetched for user e5896d2fec3743bfb75db97757fc6b18. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 04 00:09:00 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba3ce4d-3f83-4102-9dcd-989574e7e67b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_0vdoqakqdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:00 devstack sudo[101323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_0vdoqakqdevstack@QuobyteHD
Jul 04 00:09:00 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Flow 'volume_create_manager' (5984a515-c5de-4b23-82e9-9ba09e72243b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13a783c-4044-445e-8791-0763acf04ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13a783c-4044-445e-8791-0763acf04ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1478775198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee0388f-cdfa-4021-be2d-962c3bb14050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='858c19973731447eba4028bd55ba9938',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=06707a4d-5ae5-4465-9278-2319fbf94f2f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:01Z,use_quota=True,user_id='04de1fa664894f35be63bbfd0c6db740',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfae958-9928-4f61-8590-62f304a4d0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfae958-9928-4f61-8590-62f304a4d0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db04d11b-e7c7-4702-b5e8-09e2f391af69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db04d11b-e7c7-4702-b5e8-09e2f391af69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bee0388f-cdfa-4021-be2d-962c3bb14050', 'volume_name': 'volume-bee0388f-cdfa-4021-be2d-962c3bb14050', 'volume_size': 1, 'snapshot_id': '06707a4d-5ae5-4465-9278-2319fbf94f2f'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346b05c4-cc6c-48b9-aac4-7b1cc304cee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346b05c4-cc6c-48b9-aac4-7b1cc304cee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27468198-8fd9-41f6-abc5-1490543d5266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:01 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Volume bee0388f-cdfa-4021-be2d-962c3bb14050: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bee0388f-cdfa-4021-be2d-962c3bb14050', 'volume_size': 1, 'snapshot_id': '06707a4d-5ae5-4465-9278-2319fbf94f2f'}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Acquiring lock "cinder-quobyte-06707a4d-5ae5-4465-9278-2319fbf94f2f-bee0388f-cdfa-4021-be2d-962c3bb14050" by "_create_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-quobyte-06707a4d-5ae5-4465-9278-2319fbf94f2f-bee0388f-cdfa-4021-be2d-962c3bb14050" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Creating volume bee0388f-cdfa-4021-be2d-962c3bb14050 from snapshot 06707a4d-5ae5-4465-9278-2319fbf94f2f {{(pid=86650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Acquiring lock "cinder-quobyte-bee0388f-cdfa-4021-be2d-962c3bb14050" by "_copy_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-quobyte-bee0388f-cdfa-4021-be2d-962c3bb14050" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] snapshot: 06707a4d-5ae5-4465-9278-2319fbf94f2f, volume: bee0388f-cdfa-4021-be2d-962c3bb14050,  {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d724563-e690-4d12-84f8-c14839576f93]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:01 devstack sudo[101325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f
Jul 04 00:09:01 devstack sudo[101325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:01 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_0vdoqakqdevstack@QuobyteHD" returned: 0 in 0.779s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:02 devstack sudo[101325]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f" returned: 0 in 0.788s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:09:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] will copy from snapshot at /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:09:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Creating direct copy from snapshot {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:09:02 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d6f84e-51d4-4206-b187-8776cdad6c05]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:02 devstack sudo[101333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0
Jul 04 00:09:02 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:02 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0" returned: 0 in 0.766s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:02 devstack cinder-volume[86650]: DEBUG cinder.utils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Path /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bee0388f-cdfa-4021-be2d-962c3bb14050 not found in is_blk_device check {{(pid=86650) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:09:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bee0388f-cdfa-4021-be2d-962c3bb14050 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:02 devstack sudo[101338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bee0388f-cdfa-4021-be2d-962c3bb14050
Jul 04 00:09:02 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:07 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bee0388f-cdfa-4021-be2d-962c3bb14050" returned: 0 in 4.663s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:07 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f9d8d1-5bee-4457-aac2-46f77b31ae0a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:07 devstack sudo[101352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0
Jul 04 00:09:07 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:08 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0" returned: 0 in 0.979s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:08 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Image conversion details: src /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bee0388f-cdfa-4021-be2d-962c3bb14050 {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:09:08 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Converted 1024.00 MB image at 219.55 MB/s
Jul 04 00:09:08 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bee0388f-cdfa-4021-be2d-962c3bb14050 is being set with open permissions: ugo+rw
Jul 04 00:09:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bee0388f-cdfa-4021-be2d-962c3bb14050 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:08 devstack sudo[101357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bee0388f-cdfa-4021-be2d-962c3bb14050
Jul 04 00:09:08 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:09 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bee0388f-cdfa-4021-be2d-962c3bb14050" returned: 0 in 0.678s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-quobyte-bee0388f-cdfa-4021-be2d-962c3bb14050" released by "_copy_volume_from_snapshot" :: held 7.979s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-quobyte-06707a4d-5ae5-4465-9278-2319fbf94f2f-bee0388f-cdfa-4021-be2d-962c3bb14050" released by "_create_volume_from_snapshot" :: held 8.012s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.027s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.777s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-47757246',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3739af74-e602-49e4-81f5-f22edc56b579,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53035170bc86499a98f856ee6de94261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:08:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:08:59Z,use_quota=True,user_id='e5896d2fec3743bfb75db97757fc6b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Creating volume 3739af74-e602-49e4-81f5-f22edc56b579 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:09:09 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:09 devstack sudo[101360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 1073741824
Jul 04 00:09:09 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27468198-8fd9-41f6-abc5-1490543d5266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee0388f-cdfa-4021-be2d-962c3bb14050', 'volume_size': 1, 'snapshot_id': '06707a4d-5ae5-4465-9278-2319fbf94f2f'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eedf1c4-d704-4b7c-a270-e2e98d650921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:09 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Volume volume-bee0388f-cdfa-4021-be2d-962c3bb14050 (bee0388f-cdfa-4021-be2d-962c3bb14050): created successfully
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eedf1c4-d704-4b7c-a270-e2e98d650921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Flow 'volume_create_manager' (5984a515-c5de-4b23-82e9-9ba09e72243b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:09 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-1642f017-1775-47e8-85b4-2f6cd548a2f1 tempest-VolumeDependencyTests-528073734 None] Created volume successfully.
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Acquiring lock "cinder-06707a4d-5ae5-4465-9278-2319fbf94f2f-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-06707a4d-5ae5-4465-9278-2319fbf94f2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Acquiring lock "cinder-quobyte-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-quobyte-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Acquiring lock "cinder-quobyte-06707a4d-5ae5-4465-9278-2319fbf94f2f" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-quobyte-06707a4d-5ae5-4465-9278-2319fbf94f2f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Deleting offline snapshot 06707a4d-5ae5-4465-9278-2319fbf94f2f of volume fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] snapshot_file for this snap is: volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7e132d-931a-4393-ba92-498d30942569]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:10 devstack sudo[101365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f
Jul 04 00:09:10 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:10 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 1073741824" returned: 0 in 0.827s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:10 devstack sudo[101368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579
Jul 04 00:09:10 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:10 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f" returned: 0 in 0.802s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:09:10 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[520ab858-8a42-4af3-ad0a-b326e715cc1b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:10 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579" returned: 0 in 0.634s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:09:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:10 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Attempting download of b8f0cc76-877f-40ea-bce4-db07a2ff6489 ((None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}])) to volume 3739af74-e602-49e4-81f5-f22edc56b579. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 04 00:09:10 devstack sudo[101374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0
Jul 04 00:09:10 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:10 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2c7d7f-e382-4959-afa3-9ff6125b81fa]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_1blhwbna {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:11 devstack sudo[101376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_1blhwbna
Jul 04 00:09:11 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:11 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0" returned: 0 in 0.751s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:11 devstack sudo[101381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f
Jul 04 00:09:11 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:11 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_1blhwbna" returned: 0 in 0.796s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_1blhwbna {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:11 devstack sudo[101385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_1blhwbna
Jul 04 00:09:11 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:12 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f" returned: 0 in 0.740s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:12 devstack sudo[101390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f
Jul 04 00:09:12 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:12 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_1blhwbna" returned: 1 in 0.754s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b8f0cc76-877f-40ea-bce4-db07a2ff6489_1blhwbna' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:09:12 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[595d3889-0efa-4ed4-849c-73592b99f359]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_0vdoqakqdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:12 devstack sudo[101394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_0vdoqakqdevstack@QuobyteHD
Jul 04 00:09:12 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:12 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0.06707a4d-5ae5-4465-9278-2319fbf94f2f" returned: 0 in 0.684s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-quobyte-06707a4d-5ae5-4465-9278-2319fbf94f2f" released by "_delete_snapshot" :: held 3.102s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-quobyte-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0" released by "delete_snapshot" :: held 3.126s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:13 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Created reservations ['065593f0-b18a-4c2a-ac09-02f7319e079a', '52852abc-ad4b-4b9a-93dc-25d34d27e744', 'd8bc123f-bb18-4246-ab44-323adc23f73b', '61c1564d-9f29-4ff8-be0d-50ffea30db8c'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:09:13 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Delete snapshot completed successfully.
Jul 04 00:09:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ddec8cfc-3db0-4a8e-9eb4-eae27184c480 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-06707a4d-5ae5-4465-9278-2319fbf94f2f-delete_snapshot" released by "delete_snapshot" :: held 3.274s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:13 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_0vdoqakqdevstack@QuobyteHD" returned: 0 in 0.731s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:13 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] b8f0cc76-877f-40ea-bce4-db07a2ff6489 was qcow2, converting to raw {{(pid=86650) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 04 00:09:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_0vdoqakqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:13 devstack sudo[101400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_0vdoqakqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579
Jul 04 00:09:13 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Acquiring lock "cinder-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Acquiring lock "cinder-quobyte-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-quobyte-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0" acquired by "delete_volume" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:14 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[0708b796-339c-4ac0-ab46-bc9aea629bf2]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:09:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:14 devstack sudo[101413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:09:14 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:14 devstack sudo[101412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0
Jul 04 00:09:14 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:15 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_0vdoqakqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579" returned: 0 in 1.979s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:15 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b8f0cc76-877f-40ea-bce4-db07a2ff6489_0vdoqakqdevstack@QuobyteHD, size 112.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:09:15 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Converted 112.00 MB image at 56.54 MB/s
Jul 04 00:09:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:15 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.778s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:09:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:09:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:09:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:09:15 devstack sudo[101420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 1G
Jul 04 00:09:15 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:15 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0" returned: 0 in 0.931s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:15 devstack sudo[101422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0
Jul 04 00:09:15 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:15 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 1G" returned: 0 in 0.744s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:15 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0" returned: 0 in 0.691s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-quobyte-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0" released by "delete_volume" :: held 1.704s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded09015-f640-4ef3-b873-8a031d6db62f]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Created reservations ['d80f0776-5699-4ba6-ab86-9fd7c1ebaef9', '92f03203-e5c7-4526-a4db-7e411f6a198f', '70746a43-7785-42de-80f8-ad3e08368c97', '6389145d-162e-40ed-a52c-fa9e7f578b1b'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:09:16 devstack sudo[101428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579
Jul 04 00:09:16 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:16 devstack sudo[101430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:09:16 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Acquiring lock "cinder-bee0388f-cdfa-4021-be2d-962c3bb14050-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-bee0388f-cdfa-4021-be2d-962c3bb14050-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Acquiring lock "cinder-quobyte-bee0388f-cdfa-4021-be2d-962c3bb14050" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-quobyte-bee0388f-cdfa-4021-be2d-962c3bb14050" acquired by "delete_volume" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db6b4fa-5a4b-4843-a7b3-c1d88d1f1a42]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bee0388f-cdfa-4021-be2d-962c3bb14050 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:16 devstack sudo[101432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bee0388f-cdfa-4021-be2d-962c3bb14050
Jul 04 00:09:16 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:16 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579" returned: 0 in 0.833s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:16 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.748s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:09:16 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Deleted volume successfully.
Jul 04 00:09:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7697df89-12ab-405e-837c-7df0e7a18ec5 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-fc16fa3f-ff5f-440f-b0a5-7d0616d237a0-delete_volume" released by "delete_volume" :: held 2.718s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:16 devstack sudo[101437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579
Jul 04 00:09:16 devstack sudo[101437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:17 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bee0388f-cdfa-4021-be2d-962c3bb14050" returned: 0 in 0.833s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bee0388f-cdfa-4021-be2d-962c3bb14050 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:17 devstack sudo[101443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bee0388f-cdfa-4021-be2d-962c3bb14050
Jul 04 00:09:17 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:17 devstack sudo[101437]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579" returned: 1 in 0.804s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:09:17 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Downloaded image b8f0cc76-877f-40ea-bce4-db07a2ff6489 ((None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}])) to volume 3739af74-e602-49e4-81f5-f22edc56b579 successfully. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 04 00:09:17 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Temporary image b8f0cc76-877f-40ea-bce4-db07a2ff6489 for user e5896d2fec3743bfb75db97757fc6b18 is deleted. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 04 00:09:17 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Marking volume 3739af74-e602-49e4-81f5-f22edc56b579 as bootable. {{(pid=86650) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 04 00:09:17 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Copying metadata from image b8f0cc76-877f-40ea-bce4-db07a2ff6489 to 3739af74-e602-49e4-81f5-f22edc56b579. {{(pid=86650) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 04 00:09:17 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Creating volume glance metadata for volume 3739af74-e602-49e4-81f5-f22edc56b579 backed by image b8f0cc76-877f-40ea-bce4-db07a2ff6489 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86650) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 04 00:09:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daed748d-6dd6-4bfb-be19-031c9ce122dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3739af74-e602-49e4-81f5-f22edc56b579', 'volume_size': 1, 'image_id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ee7f20f7f01043bc91ea80a8d5f6c3f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b8f0cc76-877f-40ea-bce4-db07a2ff6489', 'created_at': datetime.datetime(2026, 7, 3, 21, 43, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 21, 43, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b8f0cc76-877f-40ea-bce4-db07a2ff6489/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000b75100>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6edba958-78bf-4c33-b7d6-ecdf34794925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:17 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Volume volume-3739af74-e602-49e4-81f5-f22edc56b579 (3739af74-e602-49e4-81f5-f22edc56b579): created successfully
Jul 04 00:09:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6edba958-78bf-4c33-b7d6-ecdf34794925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Flow 'volume_create_manager' (cdf63ff1-b664-4baa-9f28-c03421bf61a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:17 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f0166d2d-861f-4c5e-8eec-7982bdab3639 tempest-TestShelveInstance-1996382554 None] Created volume successfully.
Jul 04 00:09:18 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bee0388f-cdfa-4021-be2d-962c3bb14050" returned: 0 in 0.703s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-quobyte-bee0388f-cdfa-4021-be2d-962c3bb14050" released by "delete_volume" :: held 1.584s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:18 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Created reservations ['08d72e3e-a867-450d-8122-6237c4b82e01', '9a1a8271-816e-4308-ae6e-32939774c1d9', 'fa256021-304f-4bbe-9e0e-3bc49655f2a1', '329e0bec-7efd-48c2-bc5d-f395987e0f0f'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:09:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:18 devstack sudo[101449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:09:18 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:18 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.694s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:18 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:09:18 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Deleted volume successfully.
Jul 04 00:09:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b992af3a-b988-45c5-85d1-602674af4089 tempest-VolumeDependencyTests-528073734 None] Lock "cinder-bee0388f-cdfa-4021-be2d-962c3bb14050-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:24 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:09:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Flow 'volume_create_manager' (77cdbf29-dcfc-4662-873a-b897aade9d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876618fa-a011-438f-bdc8-a31670241a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876618fa-a011-438f-bdc8-a31670241a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635b1201-3088-47fa-8cb4-a9c3b4d76e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37cac68fd2434668a0a232813158526c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:24Z,use_quota=True,user_id='163ae697e62048feb2ca07126a6e8f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b28a77-399d-4850-a673-1acbde34a52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b28a77-399d-4850-a673-1acbde34a52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac417cf-ce16-4697-8722-be94bbf98832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:24 devstack cinder-volume[86650]: DEBUG cinder.image.glance [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Creating Keystone auth plugin from conf {{(pid=86650) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 04 00:09:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac417cf-ce16-4697-8722-be94bbf98832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '635b1201-3088-47fa-8cb4-a9c3b4d76e9e', 'volume_name': 'volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e', 'volume_size': 1, 'image_id': 'be586b4f-b2fd-4134-989f-5e58b5d68a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be586b4f-b2fd-4134-989f-5e58b5d68a47', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3f03a11aeb422c364f08c6717f6e737', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '37cac68fd2434668a0a232813158526c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3d73cdc8bcabdd2d15cd545a69f663dfcac10cb03504efeaf423ff12af47f1170032d03909cc1ecee53b51ad8e4f85061c13e528e5678e39cc907da40f8667da', 'id': 'be586b4f-b2fd-4134-989f-5e58b5d68a47', 'created_at': datetime.datetime(2026, 7, 3, 22, 9, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 9, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be586b4f-b2fd-4134-989f-5e58b5d68a47/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000e84200>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ba1bf0-52ae-4917-87d6-a08256fa24f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8ba1bf0-52ae-4917-87d6-a08256fa24f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0397c8f9-72bc-444a-a1df-003b8413330c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:24 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Volume 635b1201-3088-47fa-8cb4-a9c3b4d76e9e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e', 'volume_size': 1, 'image_id': 'be586b4f-b2fd-4134-989f-5e58b5d68a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be586b4f-b2fd-4134-989f-5e58b5d68a47', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3f03a11aeb422c364f08c6717f6e737', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '37cac68fd2434668a0a232813158526c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3d73cdc8bcabdd2d15cd545a69f663dfcac10cb03504efeaf423ff12af47f1170032d03909cc1ecee53b51ad8e4f85061c13e528e5678e39cc907da40f8667da', 'id': 'be586b4f-b2fd-4134-989f-5e58b5d68a47', 'created_at': datetime.datetime(2026, 7, 3, 22, 9, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 9, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be586b4f-b2fd-4134-989f-5e58b5d68a47/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000e84200>}
Jul 04 00:09:24 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Trying to clone 635b1201-3088-47fa-8cb4-a9c3b4d76e9e from image be586b4f-b2fd-4134-989f-5e58b5d68a47 at location (None, [{'url': 'file:///opt/stack/data/glance/images/be586b4f-b2fd-4134-989f-5e58b5d68a47', 'metadata': {}}]). {{(pid=86650) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 04 00:09:24 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 04 00:09:24 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Image download 0.00 MB at 0.00 MB/s
Jul 04 00:09:24 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1339462-99e0-477f-8151-f7218e0e73ca]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:24 devstack sudo[101459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD
Jul 04 00:09:24 devstack sudo[101459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:25 devstack sudo[101459]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD" returned: 0 in 0.897s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:25 devstack sudo[101464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD
Jul 04 00:09:25 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-5e4a08ab-dfe5-48fe-8451-440f55b5e039 req-da545698-89f7-436a-84d7-4d94a4d48094 tempest-TestShelveInstance-1996382554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-5e4a08ab-dfe5-48fe-8451-440f55b5e039 req-da545698-89f7-436a-84d7-4d94a4d48094 tempest-TestShelveInstance-1996382554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:26 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c17ed6-10ba-4e23-abdd-cad37503c1b7]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-5e4a08ab-dfe5-48fe-8451-440f55b5e039 req-da545698-89f7-436a-84d7-4d94a4d48094 tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:26 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD" returned: 1 in 0.752s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:09:26 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Temporary image be586b4f-b2fd-4134-989f-5e58b5d68a47 is fetched for user 163ae697e62048feb2ca07126a6e8f4d. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 04 00:09:26 devstack sudo[101477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579
Jul 04 00:09:26 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:26 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[537d294a-516e-4ba4-8c4d-105e9527d181]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:26 devstack sudo[101479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD
Jul 04 00:09:26 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:27 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-5e4a08ab-dfe5-48fe-8451-440f55b5e039 req-da545698-89f7-436a-84d7-4d94a4d48094 tempest-TestShelveInstance-1996382554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579" returned: 0 in 0.773s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-5e4a08ab-dfe5-48fe-8451-440f55b5e039 req-da545698-89f7-436a-84d7-4d94a4d48094 tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:27 devstack sudo[101484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579
Jul 04 00:09:27 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:27 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD" returned: 0 in 0.760s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:27 devstack sudo[101488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD
Jul 04 00:09:27 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:27 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-5e4a08ab-dfe5-48fe-8451-440f55b5e039 req-da545698-89f7-436a-84d7-4d94a4d48094 tempest-TestShelveInstance-1996382554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579" returned: 1 in 0.777s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-5e4a08ab-dfe5-48fe-8451-440f55b5e039 req-da545698-89f7-436a-84d7-4d94a4d48094 tempest-TestShelveInstance-1996382554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-5e4a08ab-dfe5-48fe-8451-440f55b5e039 req-da545698-89f7-436a-84d7-4d94a4d48094 tempest-TestShelveInstance-1996382554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.604s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-5e4a08ab-dfe5-48fe-8451-440f55b5e039 req-da545698-89f7-436a-84d7-4d94a4d48094 tempest-TestShelveInstance-1996382554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-3739af74-e602-49e4-81f5-f22edc56b579', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90f657bd-3896-458e-9c54-ddc07f46afff', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:09:27 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD" returned: 1 in 0.712s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635b1201-3088-47fa-8cb4-a9c3b4d76e9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37cac68fd2434668a0a232813158526c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:09:24Z,use_quota=True,user_id='163ae697e62048feb2ca07126a6e8f4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Creating volume 635b1201-3088-47fa-8cb4-a9c3b4d76e9e {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:09:27 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:09:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:27 devstack sudo[101496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e 1073741824
Jul 04 00:09:27 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:27 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-5e4a08ab-dfe5-48fe-8451-440f55b5e039 req-da545698-89f7-436a-84d7-4d94a4d48094 tempest-TestShelveInstance-1996382554 None] attachment_update completed successfully.
Jul 04 00:09:28 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e 1073741824" returned: 0 in 0.845s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:28 devstack sudo[101502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e
Jul 04 00:09:28 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:29 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e" returned: 0 in 0.626s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:09:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:29 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Attempting download of be586b4f-b2fd-4134-989f-5e58b5d68a47 ((None, [{'url': 'file:///opt/stack/data/glance/images/be586b4f-b2fd-4134-989f-5e58b5d68a47', 'metadata': {}}])) to volume 635b1201-3088-47fa-8cb4-a9c3b4d76e9e. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 04 00:09:29 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b307364a-b0a5-488b-bb0b-f4ea44764018]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be586b4f-b2fd-4134-989f-5e58b5d68a47_zmb11kmd {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:29 devstack sudo[101505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be586b4f-b2fd-4134-989f-5e58b5d68a47_zmb11kmd
Jul 04 00:09:29 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:30 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_be586b4f-b2fd-4134-989f-5e58b5d68a47_zmb11kmd" returned: 0 in 0.732s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be586b4f-b2fd-4134-989f-5e58b5d68a47_zmb11kmd {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:30 devstack sudo[101576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be586b4f-b2fd-4134-989f-5e58b5d68a47_zmb11kmd
Jul 04 00:09:30 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:30 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be586b4f-b2fd-4134-989f-5e58b5d68a47_zmb11kmd" returned: 1 in 0.685s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_be586b4f-b2fd-4134-989f-5e58b5d68a47_zmb11kmd' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:09:30 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdaeb02-fb35-4693-bbf4-4d36cf1c6f90]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:31 devstack sudo[101580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD
Jul 04 00:09:31 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:31 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD" returned: 0 in 0.954s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:31 devstack sudo[101626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD
Jul 04 00:09:31 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:32 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD" returned: 1 in 0.714s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:09:32 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] be586b4f-b2fd-4134-989f-5e58b5d68a47 was raw, converting to raw {{(pid=86650) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 04 00:09:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:32 devstack sudo[101634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e
Jul 04 00:09:32 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:33 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e" returned: 0 in 0.790s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:33 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_be586b4f-b2fd-4134-989f-5e58b5d68a47_oqmc05bkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:09:33 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Converted 0.00 MB image at 0.00 MB/s
Jul 04 00:09:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:33 devstack sudo[101969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e 1G
Jul 04 00:09:33 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:34 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e 1G" returned: 0 in 0.807s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:34 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5e3a62-8e27-48dd-8e6b-ca69f722b545]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:34 devstack sudo[101977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e
Jul 04 00:09:34 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:35 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e" returned: 0 in 0.905s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:35 devstack sudo[101981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e
Jul 04 00:09:35 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:36 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e" returned: 1 in 0.882s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:09:36 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Downloaded image be586b4f-b2fd-4134-989f-5e58b5d68a47 ((None, [{'url': 'file:///opt/stack/data/glance/images/be586b4f-b2fd-4134-989f-5e58b5d68a47', 'metadata': {}}])) to volume 635b1201-3088-47fa-8cb4-a9c3b4d76e9e successfully. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 04 00:09:36 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Temporary image be586b4f-b2fd-4134-989f-5e58b5d68a47 for user 163ae697e62048feb2ca07126a6e8f4d is deleted. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 04 00:09:36 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Marking volume 635b1201-3088-47fa-8cb4-a9c3b4d76e9e as bootable. {{(pid=86650) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 04 00:09:36 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Copying metadata from image be586b4f-b2fd-4134-989f-5e58b5d68a47 to 635b1201-3088-47fa-8cb4-a9c3b4d76e9e. {{(pid=86650) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 04 00:09:36 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Creating volume glance metadata for volume 635b1201-3088-47fa-8cb4-a9c3b4d76e9e backed by image be586b4f-b2fd-4134-989f-5e58b5d68a47 with: {'image_id': 'be586b4f-b2fd-4134-989f-5e58b5d68a47', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd3f03a11aeb422c364f08c6717f6e737', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86650) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 04 00:09:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0397c8f9-72bc-444a-a1df-003b8413330c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e', 'volume_size': 1, 'image_id': 'be586b4f-b2fd-4134-989f-5e58b5d68a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/be586b4f-b2fd-4134-989f-5e58b5d68a47', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd3f03a11aeb422c364f08c6717f6e737', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '37cac68fd2434668a0a232813158526c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3d73cdc8bcabdd2d15cd545a69f663dfcac10cb03504efeaf423ff12af47f1170032d03909cc1ecee53b51ad8e4f85061c13e528e5678e39cc907da40f8667da', 'id': 'be586b4f-b2fd-4134-989f-5e58b5d68a47', 'created_at': datetime.datetime(2026, 7, 3, 22, 9, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 9, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/be586b4f-b2fd-4134-989f-5e58b5d68a47/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000e84200>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40aec7f4-2a3a-4624-bf0b-efd8204e7ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:09:36 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Volume volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e (635b1201-3088-47fa-8cb4-a9c3b4d76e9e): created successfully
Jul 04 00:09:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40aec7f4-2a3a-4624-bf0b-efd8204e7ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:09:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Flow 'volume_create_manager' (77cdbf29-dcfc-4662-873a-b897aade9d95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:09:36 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f4d961e3-6c75-4c79-93f5-0194c8a4b58e tempest-VolumeImageDependencyTests-968313939 None] Created volume successfully.
Jul 04 00:09:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Acquiring lock "cinder-635b1201-3088-47fa-8cb4-a9c3b4d76e9e-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Lock "cinder-635b1201-3088-47fa-8cb4-a9c3b4d76e9e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Acquiring lock "cinder-quobyte-635b1201-3088-47fa-8cb4-a9c3b4d76e9e" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:09:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Lock "cinder-quobyte-635b1201-3088-47fa-8cb4-a9c3b4d76e9e" acquired by "delete_volume" :: waited 0.026s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:09:37 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1285ce8a-91c2-4025-9e00-4a197f25cbc2]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:09:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:37 devstack sudo[101987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e
Jul 04 00:09:37 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:38 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e" returned: 0 in 0.836s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:38 devstack sudo[101993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e
Jul 04 00:09:38 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:39 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e" returned: 1 in 1.002s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:09:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:39 devstack sudo[101999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e
Jul 04 00:09:39 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:39 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-635b1201-3088-47fa-8cb4-a9c3b4d76e9e" returned: 0 in 0.760s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Lock "cinder-quobyte-635b1201-3088-47fa-8cb4-a9c3b4d76e9e" released by "delete_volume" :: held 2.688s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:40 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Created reservations ['72fbe52c-5c19-4876-8a19-ceb3680fdd6a', 'bb674af3-0731-430b-a489-b1da4ac7e0fb', 'b61de12c-3385-435f-a2bf-7a67ea188023', 'd057b71c-f5cf-441f-b4c8-ffa9d075f0fa'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:09:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:09:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:09:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:09:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:09:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:09:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:09:40 devstack sudo[102003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:09:40 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:09:40 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root
Jul 04 00:09:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.741s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:09:40 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:09:40 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Deleted volume successfully.
Jul 04 00:09:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-1850a82d-58a0-471b-b7a3-42403dff2ad4 tempest-VolumeImageDependencyTests-968313939 None] Lock "cinder-635b1201-3088-47fa-8cb4-a9c3b4d76e9e-delete_volume" released by "delete_volume" :: held 3.747s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:09:50 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=45,cinder:UPDATE=51,cinder:INSERT=20,cinder:DELETE=3 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:09:50 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=57,cinder:UPDATE=42,cinder:DELETE=5,cinder:INSERT=22 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:10:05 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-b675e9e6-772a-4b0c-8e4f-4172513854bf req-3ef9f0ad-456d-40be-b6d6-89c49065887c tempest-TestShelveInstance-1996382554 None] Terminate volume connection completed successfully.
Jul 04 00:10:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-b675e9e6-772a-4b0c-8e4f-4172513854bf req-3ef9f0ad-456d-40be-b6d6-89c49065887c tempest-TestShelveInstance-1996382554 None] Deleting attachment 90f657bd-3896-458e-9c54-ddc07f46afff. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:10:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-723b0620-1066-4764-95db-70c8c4a8bc6c req-3c527f38-a311-492d-8022-53d15233f3a3 tempest-TestShelveInstance-1996382554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:10:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-723b0620-1066-4764-95db-70c8c4a8bc6c req-3c527f38-a311-492d-8022-53d15233f3a3 tempest-TestShelveInstance-1996382554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:10:10 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed537f36-b91f-439d-a41f-73634104c4d9]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:10:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-723b0620-1066-4764-95db-70c8c4a8bc6c req-3c527f38-a311-492d-8022-53d15233f3a3 tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:10 devstack sudo[102794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579
Jul 04 00:10:10 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:11 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-723b0620-1066-4764-95db-70c8c4a8bc6c req-3c527f38-a311-492d-8022-53d15233f3a3 tempest-TestShelveInstance-1996382554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579" returned: 0 in 0.724s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-723b0620-1066-4764-95db-70c8c4a8bc6c req-3c527f38-a311-492d-8022-53d15233f3a3 tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:11 devstack sudo[102798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579
Jul 04 00:10:11 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:11 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-723b0620-1066-4764-95db-70c8c4a8bc6c req-3c527f38-a311-492d-8022-53d15233f3a3 tempest-TestShelveInstance-1996382554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579" returned: 1 in 0.704s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-723b0620-1066-4764-95db-70c8c4a8bc6c req-3c527f38-a311-492d-8022-53d15233f3a3 tempest-TestShelveInstance-1996382554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:10:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-723b0620-1066-4764-95db-70c8c4a8bc6c req-3c527f38-a311-492d-8022-53d15233f3a3 tempest-TestShelveInstance-1996382554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.464s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:10:12 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-723b0620-1066-4764-95db-70c8c4a8bc6c req-3c527f38-a311-492d-8022-53d15233f3a3 tempest-TestShelveInstance-1996382554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-3739af74-e602-49e4-81f5-f22edc56b579', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c4001d3-e238-439c-b678-76c07ddb0d7a', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:10:12 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-723b0620-1066-4764-95db-70c8c4a8bc6c req-3c527f38-a311-492d-8022-53d15233f3a3 tempest-TestShelveInstance-1996382554 None] attachment_update completed successfully.
Jul 04 00:10:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:10:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:10:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:10:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:10:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:10:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:10:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:10:14 devstack sudo[102804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:10:14 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:10:15 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root
Jul 04 00:10:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.672s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:10:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:10:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:10:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:10:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:10:22 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:10:22 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:11:06 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-62b531df-7934-4b97-bed5-256126d5dc03 req-f0c61f63-933c-4c52-b557-31a703aec17f tempest-TestShelveInstance-1996382554 None] Terminate volume connection completed successfully.
Jul 04 00:11:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-62b531df-7934-4b97-bed5-256126d5dc03 req-f0c61f63-933c-4c52-b557-31a703aec17f tempest-TestShelveInstance-1996382554 None] Deleting attachment 9c4001d3-e238-439c-b678-76c07ddb0d7a. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:11:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Acquiring lock "cinder-3739af74-e602-49e4-81f5-f22edc56b579-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Lock "cinder-3739af74-e602-49e4-81f5-f22edc56b579-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Acquiring lock "cinder-quobyte-3739af74-e602-49e4-81f5-f22edc56b579" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:11:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Lock "cinder-quobyte-3739af74-e602-49e4-81f5-f22edc56b579" acquired by "delete_volume" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:11:06 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e5f067-8f8e-4621-94e8-3a6969b3ffa1]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:11:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:07 devstack sudo[103371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579
Jul 04 00:11:07 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:07 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579" returned: 0 in 0.808s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:07 devstack sudo[103375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579
Jul 04 00:11:07 devstack sudo[103375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:08 devstack sudo[103375]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579" returned: 1 in 0.835s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:11:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:08 devstack sudo[103380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579
Jul 04 00:11:08 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:09 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3739af74-e602-49e4-81f5-f22edc56b579" returned: 0 in 0.714s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Lock "cinder-quobyte-3739af74-e602-49e4-81f5-f22edc56b579" released by "delete_volume" :: held 2.420s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:09 devstack cinder-volume[86650]: DEBUG cinder.quota [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Created reservations ['db1fd6da-b50e-4484-9f3f-8a6230787d7a', '3dd08934-3a5c-4d3b-8cc2-dddbd4550bb9', '97e1c17a-4d6c-4e2b-9213-e4b866f55419', 'baf8a9a1-0410-41ac-a779-5469ede0eb3a'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:11:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:09 devstack sudo[103383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:11:09 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:10 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.781s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:10 devstack cinder-volume[86650]: DEBUG cinder.manager [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:10 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Deleted volume successfully.
Jul 04 00:11:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [req-62b531df-7934-4b97-bed5-256126d5dc03 req-0c44480b-3044-4588-b1ad-27ca94608e8b tempest-TestShelveInstance-1996382554 None] Lock "cinder-3739af74-e602-49e4-81f5-f22edc56b579-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:11:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:11:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:14 devstack sudo[103389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:11:14 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:15 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.768s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:11:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:11:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:11:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:11:19 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=8 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:11:20 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:11:41 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Flow 'volume_create_manager' (e4734bce-8935-4664-a098-062cb12bfd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b866d7-2016-4388-a00e-3d19e468301a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b866d7-2016-4388-a00e-3d19e468301a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-456519604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43926e5a-6029-4e92-b560-cf273a9dda65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca5253602504776b99373db1e5460e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:42Z,use_quota=True,user_id='1a444dd0875b4fc198c9e5698659238d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eadd787-e7e0-4ccc-b0a5-1ca0d138512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eadd787-e7e0-4ccc-b0a5-1ca0d138512b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b13bf9-5ad2-48ca-99e7-046ef9547aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b13bf9-5ad2-48ca-99e7-046ef9547aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43926e5a-6029-4e92-b560-cf273a9dda65', 'volume_name': 'volume-43926e5a-6029-4e92-b560-cf273a9dda65', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613d5731-d65b-4149-85f3-104dd6b52030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (613d5731-d65b-4149-85f3-104dd6b52030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891742a1-3194-441b-9293-b06f4b2f6936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:42 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Volume 43926e5a-6029-4e92-b560-cf273a9dda65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43926e5a-6029-4e92-b560-cf273a9dda65', 'volume_size': 1}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-456519604',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43926e5a-6029-4e92-b560-cf273a9dda65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca5253602504776b99373db1e5460e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:11:42Z,use_quota=True,user_id='1a444dd0875b4fc198c9e5698659238d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Creating volume 43926e5a-6029-4e92-b560-cf273a9dda65 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:11:42 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:42 devstack sudo[103403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65 1073741824
Jul 04 00:11:42 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:42 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65 1073741824" returned: 0 in 0.904s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:11:43 devstack sudo[103412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65
Jul 04 00:11:43 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:11:43 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root
Jul 04 00:11:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65" returned: 0 in 0.693s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:11:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:11:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:11:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891742a1-3194-441b-9293-b06f4b2f6936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43926e5a-6029-4e92-b560-cf273a9dda65', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174620b8-ae11-4029-93e0-9e502a5c0221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:11:43 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Volume volume-43926e5a-6029-4e92-b560-cf273a9dda65 (43926e5a-6029-4e92-b560-cf273a9dda65): created successfully
Jul 04 00:11:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174620b8-ae11-4029-93e0-9e502a5c0221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:11:43 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Flow 'volume_create_manager' (e4734bce-8935-4664-a098-062cb12bfd30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:11:43 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-92a50cd6-b3c9-460e-afa4-3bd483602f08 tempest-TestStampPattern-643534335 None] Created volume successfully.
Jul 04 00:11:53 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:11:53 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3,cinder:DELETE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:12:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:12:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:14 devstack sudo[103564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:12:14 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:15 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.644s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:12:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:12:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:12:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:12:17 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:12:17 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:12:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-7f2307eb-7ee2-485b-a3b2-50f7724c5977 req-1cc78614-d379-4b75-8dbb-0837bf36113a tempest-TestStampPattern-643534335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-7f2307eb-7ee2-485b-a3b2-50f7724c5977 req-1cc78614-d379-4b75-8dbb-0837bf36113a tempest-TestStampPattern-643534335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:22 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a288f7-7f63-4df1-8979-32e6cc0fc775]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-7f2307eb-7ee2-485b-a3b2-50f7724c5977 req-1cc78614-d379-4b75-8dbb-0837bf36113a tempest-TestStampPattern-643534335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:22 devstack sudo[103590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65
Jul 04 00:12:22 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:23 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-7f2307eb-7ee2-485b-a3b2-50f7724c5977 req-1cc78614-d379-4b75-8dbb-0837bf36113a tempest-TestStampPattern-643534335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65" returned: 0 in 0.867s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-7f2307eb-7ee2-485b-a3b2-50f7724c5977 req-1cc78614-d379-4b75-8dbb-0837bf36113a tempest-TestStampPattern-643534335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.887s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-7f2307eb-7ee2-485b-a3b2-50f7724c5977 req-1cc78614-d379-4b75-8dbb-0837bf36113a tempest-TestStampPattern-643534335 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-43926e5a-6029-4e92-b560-cf273a9dda65', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61c79147-b808-47f0-95d4-ad1a8904d706', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:12:23 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-7f2307eb-7ee2-485b-a3b2-50f7724c5977 req-1cc78614-d379-4b75-8dbb-0837bf36113a tempest-TestStampPattern-643534335 None] attachment_update completed successfully.
Jul 04 00:12:33 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-e80de3a3-f214-42ce-b7d7-950bd0254b52 req-3dd3ce37-14e0-401d-951e-a98cfe69509a tempest-TestStampPattern-643534335 None] Terminate volume connection completed successfully.
Jul 04 00:12:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-e80de3a3-f214-42ce-b7d7-950bd0254b52 req-3dd3ce37-14e0-401d-951e-a98cfe69509a tempest-TestStampPattern-643534335 None] Deleting attachment 61c79147-b808-47f0-95d4-ad1a8904d706. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:12:33 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:12:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] Creating offline snapshot 1fb8c8f8-c1f7-421a-8b71-6326fed2cd90 of volume 43926e5a-6029-4e92-b560-cf273a9dda65 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:12:35 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcede55b-5423-4686-8ea6-3333291b3e27]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:35 devstack sudo[104028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65
Jul 04 00:12:35 devstack sudo[104028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:36 devstack sudo[104028]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65" returned: 0 in 0.742s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:36 devstack sudo[104034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90 1G
Jul 04 00:12:36 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:36 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90 1G" returned: 0 in 0.772s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43926e5a-6029-4e92-b560-cf273a9dda65 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:36 devstack sudo[104040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43926e5a-6029-4e92-b560-cf273a9dda65 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90
Jul 04 00:12:36 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:37 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43926e5a-6029-4e92-b560-cf273a9dda65 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90" returned: 0 in 0.712s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:37 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90 is being set with open permissions: ugo+rw
Jul 04 00:12:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:37 devstack sudo[104045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90
Jul 04 00:12:37 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:38 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90" returned: 0 in 0.627s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:38 devstack sudo[104050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.info
Jul 04 00:12:38 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:38 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.info" returned: 0 in 0.655s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:38 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.info is being set with open permissions: ugo+rw
Jul 04 00:12:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:38 devstack sudo[104053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.info
Jul 04 00:12:38 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:39 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.info" returned: 0 in 0.726s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.322s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:39 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ccc46361-a0ca-45f4-b1e3-6d2451d043bf tempest-TestStampPattern-643534335 None] Create snapshot completed successfully
Jul 04 00:12:49 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:12:49 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=12,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Flow 'volume_create_manager' (e644518d-1dd7-41ec-ab63-16eefec87abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb60caa-5698-4900-8b39-5fa28d3ece4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb60caa-5698-4900-8b39-5fa28d3ece4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-844835128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035677b3-cfd6-4c37-b712-54b9926c3593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ca5253602504776b99373db1e5460e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1fb8c8f8-c1f7-421a-8b71-6326fed2cd90,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:12:50Z,use_quota=True,user_id='1a444dd0875b4fc198c9e5698659238d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c53c029-1bfb-4f70-90a1-3d63af9a44bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c53c029-1bfb-4f70-90a1-3d63af9a44bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5133bd67-ca83-4159-b81f-94c99b454396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5133bd67-ca83-4159-b81f-94c99b454396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '035677b3-cfd6-4c37-b712-54b9926c3593', 'volume_name': 'volume-035677b3-cfd6-4c37-b712-54b9926c3593', 'volume_size': 1, 'snapshot_id': '1fb8c8f8-c1f7-421a-8b71-6326fed2cd90'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600b9345-be7e-4ed5-aa64-fa0a04a8e06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600b9345-be7e-4ed5-aa64-fa0a04a8e06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d14849d-2e63-417c-ad5a-c7e34ccf7465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:12:50 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Volume 035677b3-cfd6-4c37-b712-54b9926c3593: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-035677b3-cfd6-4c37-b712-54b9926c3593', 'volume_size': 1, 'snapshot_id': '1fb8c8f8-c1f7-421a-8b71-6326fed2cd90'}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Acquiring lock "cinder-quobyte-1fb8c8f8-c1f7-421a-8b71-6326fed2cd90-035677b3-cfd6-4c37-b712-54b9926c3593" by "_create_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Lock "cinder-quobyte-1fb8c8f8-c1f7-421a-8b71-6326fed2cd90-035677b3-cfd6-4c37-b712-54b9926c3593" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Creating volume 035677b3-cfd6-4c37-b712-54b9926c3593 from snapshot 1fb8c8f8-c1f7-421a-8b71-6326fed2cd90 {{(pid=86650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Acquiring lock "cinder-quobyte-035677b3-cfd6-4c37-b712-54b9926c3593" by "_copy_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Lock "cinder-quobyte-035677b3-cfd6-4c37-b712-54b9926c3593" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] snapshot: 1fb8c8f8-c1f7-421a-8b71-6326fed2cd90, volume: 035677b3-cfd6-4c37-b712-54b9926c3593,  {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c1a6ab-0c08-47ef-836a-ca979241509d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:50 devstack sudo[104088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90
Jul 04 00:12:50 devstack sudo[104088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:51 devstack sudo[104088]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90" returned: 0 in 0.877s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43926e5a-6029-4e92-b560-cf273a9dda65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:12:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] will copy from snapshot at /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65 {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:12:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Creating direct copy from snapshot {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:12:51 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4e8438-324a-4c55-bff5-e50f09d52c06]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:51 devstack sudo[104096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65
Jul 04 00:12:51 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:52 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65" returned: 0 in 0.784s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:52 devstack cinder-volume[86650]: DEBUG cinder.utils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Path /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593 not found in is_blk_device check {{(pid=86650) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:12:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:52 devstack sudo[104102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593
Jul 04 00:12:52 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:57 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593" returned: 0 in 5.578s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:57 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3911372-ae9c-4f80-908e-8d79a18aec6e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:12:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:58 devstack sudo[104159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65
Jul 04 00:12:58 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:59 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65" returned: 0 in 1.167s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:59 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Image conversion details: src /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593 {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:12:59 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Converted 1024.00 MB image at 183.54 MB/s
Jul 04 00:12:59 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593 is being set with open permissions: ugo+rw
Jul 04 00:12:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:12:59 devstack sudo[104164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593
Jul 04 00:12:59 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:12:59 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root
Jul 04 00:12:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593" returned: 0 in 0.777s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:12:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Lock "cinder-quobyte-035677b3-cfd6-4c37-b712-54b9926c3593" released by "_copy_volume_from_snapshot" :: held 9.312s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Lock "cinder-quobyte-1fb8c8f8-c1f7-421a-8b71-6326fed2cd90-035677b3-cfd6-4c37-b712-54b9926c3593" released by "_create_volume_from_snapshot" :: held 9.346s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:12:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.364s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:12:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d14849d-2e63-417c-ad5a-c7e34ccf7465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-035677b3-cfd6-4c37-b712-54b9926c3593', 'volume_size': 1, 'snapshot_id': '1fb8c8f8-c1f7-421a-8b71-6326fed2cd90'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:12:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac462d6-f193-40ba-9e34-7574177c8042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:13:00 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Volume volume-035677b3-cfd6-4c37-b712-54b9926c3593 (035677b3-cfd6-4c37-b712-54b9926c3593): created successfully
Jul 04 00:13:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ac462d6-f193-40ba-9e34-7574177c8042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:13:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Flow 'volume_create_manager' (e644518d-1dd7-41ec-ab63-16eefec87abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:13:00 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-edcd1167-8af9-4bb0-b2aa-f409e0e43441 tempest-TestStampPattern-643534335 None] Created volume successfully.
Jul 04 00:13:09 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:13:10 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:DELETE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:13:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:13:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:13:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:13:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:14 devstack sudo[104239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:13:14 devstack sudo[104239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:15 devstack sudo[104239]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.642s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:13:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:13:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:13:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:13:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-ee82b78c-4758-4916-bdb2-4e38fd513a4b req-6028b00b-2f4f-4acb-b0e2-63780d72e433 tempest-TestStampPattern-643534335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-ee82b78c-4758-4916-bdb2-4e38fd513a4b req-6028b00b-2f4f-4acb-b0e2-63780d72e433 tempest-TestStampPattern-643534335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:35 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b217fb-73e0-440e-84a3-9b869ee9678f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-ee82b78c-4758-4916-bdb2-4e38fd513a4b req-6028b00b-2f4f-4acb-b0e2-63780d72e433 tempest-TestStampPattern-643534335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:35 devstack sudo[104285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593
Jul 04 00:13:35 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:35 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [req-ee82b78c-4758-4916-bdb2-4e38fd513a4b req-6028b00b-2f4f-4acb-b0e2-63780d72e433 tempest-TestStampPattern-643534335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593" returned: 0 in 0.772s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [req-ee82b78c-4758-4916-bdb2-4e38fd513a4b req-6028b00b-2f4f-4acb-b0e2-63780d72e433 tempest-TestStampPattern-643534335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.790s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-ee82b78c-4758-4916-bdb2-4e38fd513a4b req-6028b00b-2f4f-4acb-b0e2-63780d72e433 tempest-TestStampPattern-643534335 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf', 'name': 'volume-035677b3-cfd6-4c37-b712-54b9926c3593', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '080fe500-3842-4551-97a5-db1aed25ff8e', 'enforce_multipath': True} {{(pid=86650) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 04 00:13:35 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-ee82b78c-4758-4916-bdb2-4e38fd513a4b req-6028b00b-2f4f-4acb-b0e2-63780d72e433 tempest-TestStampPattern-643534335 None] attachment_update completed successfully.
Jul 04 00:13:42 devstack cinder-volume[86650]: INFO cinder.volume.manager [req-d307a7e2-eca7-4761-9ad5-ebbe53255df4 req-58ff5b6a-49ac-47a0-89e2-6db5dfc0211c tempest-TestStampPattern-643534335 None] Terminate volume connection completed successfully.
Jul 04 00:13:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [req-d307a7e2-eca7-4761-9ad5-ebbe53255df4 req-58ff5b6a-49ac-47a0-89e2-6db5dfc0211c tempest-TestStampPattern-643534335 None] Deleting attachment 080fe500-3842-4551-97a5-db1aed25ff8e. {{(pid=86650) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 04 00:13:52 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=7,cinder:UPDATE=3 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:13:52 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=6 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:13:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Acquiring lock "cinder-035677b3-cfd6-4c37-b712-54b9926c3593-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Lock "cinder-035677b3-cfd6-4c37-b712-54b9926c3593-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Acquiring lock "cinder-quobyte-035677b3-cfd6-4c37-b712-54b9926c3593" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Lock "cinder-quobyte-035677b3-cfd6-4c37-b712-54b9926c3593" acquired by "delete_volume" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:52 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff62ebd-adc5-49d3-9dde-ccfe78cffccd]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:52 devstack sudo[104749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593
Jul 04 00:13:52 devstack sudo[104749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:53 devstack sudo[104749]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593" returned: 0 in 0.723s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:53 devstack sudo[104755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593
Jul 04 00:13:53 devstack sudo[104755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:54 devstack sudo[104755]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-035677b3-cfd6-4c37-b712-54b9926c3593" returned: 0 in 0.636s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Lock "cinder-quobyte-035677b3-cfd6-4c37-b712-54b9926c3593" released by "delete_volume" :: held 1.395s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:54 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Created reservations ['805411f1-700a-423b-932d-d15fb9d15be2', '0eda2e2f-3ff1-4a20-a63d-53fa201ae642', '0f3c2557-7ea3-4c9b-b46c-2fa4bc49d3f4', 'c5305da9-e5cc-4cbc-b85b-a583c4f31dd4'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:13:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:13:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:13:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:13:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:13:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:13:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:54 devstack sudo[104759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:13:54 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:54 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.720s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:54 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:13:54 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Deleted volume successfully.
Jul 04 00:13:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-fd7d6be7-cbb7-479c-9ee1-1d743a7a576f tempest-TestStampPattern-643534335 None] Lock "cinder-035677b3-cfd6-4c37-b712-54b9926c3593-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Acquiring lock "cinder-1fb8c8f8-c1f7-421a-8b71-6326fed2cd90-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Lock "cinder-1fb8c8f8-c1f7-421a-8b71-6326fed2cd90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Acquiring lock "cinder-quobyte-43926e5a-6029-4e92-b560-cf273a9dda65" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Lock "cinder-quobyte-43926e5a-6029-4e92-b560-cf273a9dda65" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Acquiring lock "cinder-quobyte-1fb8c8f8-c1f7-421a-8b71-6326fed2cd90" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:13:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Lock "cinder-quobyte-1fb8c8f8-c1f7-421a-8b71-6326fed2cd90" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:13:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Deleting offline snapshot 1fb8c8f8-c1f7-421a-8b71-6326fed2cd90 of volume 43926e5a-6029-4e92-b560-cf273a9dda65 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:13:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] snapshot_file for this snap is: volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:13:55 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[085f2bfb-ae62-4c21-a151-4d8b4ba14538]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:55 devstack sudo[104762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90
Jul 04 00:13:55 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:56 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90" returned: 0 in 0.820s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43926e5a-6029-4e92-b560-cf273a9dda65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:13:56 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbcbe42-b3ef-4fcd-a543-0cf8d6bff21c]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:13:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:56 devstack sudo[104803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65
Jul 04 00:13:56 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:56 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65" returned: 0 in 0.748s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:56 devstack sudo[104808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90
Jul 04 00:13:56 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:57 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90" returned: 0 in 0.711s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:13:57 devstack sudo[104813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90
Jul 04 00:13:57 devstack sudo[104813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:13:58 devstack sudo[104813]: pam_unix(sudo:session): session closed for user root
Jul 04 00:13:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65.1fb8c8f8-c1f7-421a-8b71-6326fed2cd90" returned: 0 in 0.612s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:13:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Lock "cinder-quobyte-1fb8c8f8-c1f7-421a-8b71-6326fed2cd90" released by "_delete_snapshot" :: held 2.985s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Lock "cinder-quobyte-43926e5a-6029-4e92-b560-cf273a9dda65" released by "delete_snapshot" :: held 3.009s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:13:58 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Created reservations ['03a48815-ab81-45b0-b315-07f7b13266dd', '4c92c5a3-b4be-4b20-a16c-8de2ada9585a', '148b10c6-4559-4d4f-ae11-29d81128882e', '97a90d8a-801a-4f90-a14a-5a31aaa733e7'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:13:58 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Delete snapshot completed successfully.
Jul 04 00:13:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-83e9e1d4-8e1d-43e9-96d3-3a534da83a44 tempest-TestStampPattern-643534335 None] Lock "cinder-1fb8c8f8-c1f7-421a-8b71-6326fed2cd90-delete_snapshot" released by "delete_snapshot" :: held 3.145s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Acquiring lock "cinder-43926e5a-6029-4e92-b560-cf273a9dda65-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Lock "cinder-43926e5a-6029-4e92-b560-cf273a9dda65-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Acquiring lock "cinder-quobyte-43926e5a-6029-4e92-b560-cf273a9dda65" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Lock "cinder-quobyte-43926e5a-6029-4e92-b560-cf273a9dda65" acquired by "delete_volume" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:07 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b0bbb6-d42d-4628-a40c-09691fe0a790]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:14:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:07 devstack sudo[104851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65
Jul 04 00:14:07 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:08 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65" returned: 0 in 0.793s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:08 devstack sudo[104856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65
Jul 04 00:14:08 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:09 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-43926e5a-6029-4e92-b560-cf273a9dda65" returned: 0 in 0.679s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Lock "cinder-quobyte-43926e5a-6029-4e92-b560-cf273a9dda65" released by "delete_volume" :: held 1.534s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:09 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Created reservations ['63abd305-4a27-4356-ae45-e862e4c70789', '9158b1ff-ee07-4871-b237-983f819a5b1c', '748b8d06-342d-47f4-a239-6ec9e988fd4b', '45ac7995-2aaa-4185-a3b3-635e9c056348'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:14:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:14:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:14:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:09 devstack sudo[104859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:14:09 devstack sudo[104859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:09 devstack sudo[104859]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.626s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:09 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:14:09 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Deleted volume successfully.
Jul 04 00:14:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-105b6447-f62a-49df-9e86-ae75356fc117 tempest-TestStampPattern-643534335 None] Lock "cinder-43926e5a-6029-4e92-b560-cf273a9dda65-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:14:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:14:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:14:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:14 devstack sudo[104865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:14:14 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:15 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.631s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:14:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:14:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:14:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:14:19 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=26,cinder:SELECT=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:14:19 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=15,cinder:INSERT=8,cinder:UPDATE=18,cinder:DELETE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Flow 'volume_create_manager' (ed50d7f4-c3fd-4d04-bd2d-dc88b7a17c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb916488-76aa-4bf0-8dd2-0c9309f71218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb916488-76aa-4bf0-8dd2-0c9309f71218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038931816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74cfa0d8-360c-4e96-9b55-f3049c10496d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a0568f4a7c4a1a888c3ecdaa3b0f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:21Z,use_quota=True,user_id='79cb86fbb4db4ccb9e9bb9b177caf3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8985d1f-0b6e-40b0-bf09-a65de3e3d628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8985d1f-0b6e-40b0-bf09-a65de3e3d628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936602c8-0dbc-4469-99fd-b54f87e2c1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (936602c8-0dbc-4469-99fd-b54f87e2c1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74cfa0d8-360c-4e96-9b55-f3049c10496d', 'volume_name': 'volume-74cfa0d8-360c-4e96-9b55-f3049c10496d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50912165-94d0-4b3b-90d0-2e616905ba91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50912165-94d0-4b3b-90d0-2e616905ba91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095280b3-9ba7-4dbb-8a25-9fd7d4cb434d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:20 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume 74cfa0d8-360c-4e96-9b55-f3049c10496d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74cfa0d8-360c-4e96-9b55-f3049c10496d', 'volume_size': 1}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1038931816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74cfa0d8-360c-4e96-9b55-f3049c10496d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a0568f4a7c4a1a888c3ecdaa3b0f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:21Z,use_quota=True,user_id='79cb86fbb4db4ccb9e9bb9b177caf3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Creating volume 74cfa0d8-360c-4e96-9b55-f3049c10496d {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:14:20 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:14:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:20 devstack sudo[104870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d 1073741824
Jul 04 00:14:20 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:21 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d 1073741824" returned: 0 in 0.788s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:21 devstack sudo[104876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d
Jul 04 00:14:21 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:22 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d" returned: 0 in 0.641s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:14:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (095280b3-9ba7-4dbb-8a25-9fd7d4cb434d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74cfa0d8-360c-4e96-9b55-f3049c10496d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bce6da-a85b-498a-8d6a-58b55097a5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:22 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume volume-74cfa0d8-360c-4e96-9b55-f3049c10496d (74cfa0d8-360c-4e96-9b55-f3049c10496d): created successfully
Jul 04 00:14:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bce6da-a85b-498a-8d6a-58b55097a5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Flow 'volume_create_manager' (ed50d7f4-c3fd-4d04-bd2d-dc88b7a17c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:14:22 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9a85df4b-ae32-47c7-a78a-25e4c544e059 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Created volume successfully.
Jul 04 00:14:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Creating offline snapshot 75038809-dbb7-4618-8fd0-e4fcbc489bfe of volume 74cfa0d8-360c-4e96-9b55-f3049c10496d {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:14:22 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[242f9ad4-05a9-4c2c-8943-967035b670a5]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:14:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:22 devstack sudo[104881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d
Jul 04 00:14:22 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:23 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d" returned: 0 in 0.742s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:23 devstack sudo[104886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe 1G
Jul 04 00:14:23 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:24 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe 1G" returned: 0 in 0.755s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74cfa0d8-360c-4e96-9b55-f3049c10496d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:24 devstack sudo[104892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74cfa0d8-360c-4e96-9b55-f3049c10496d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe
Jul 04 00:14:24 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:24 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74cfa0d8-360c-4e96-9b55-f3049c10496d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe" returned: 0 in 0.653s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:24 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe is being set with open permissions: ugo+rw
Jul 04 00:14:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:25 devstack sudo[104897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe
Jul 04 00:14:25 devstack sudo[104897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:25 devstack sudo[104897]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe" returned: 0 in 0.619s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:25 devstack sudo[104900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.info
Jul 04 00:14:25 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:26 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.info" returned: 0 in 0.634s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:26 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.info is being set with open permissions: ugo+rw
Jul 04 00:14:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:26 devstack sudo[104903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.info
Jul 04 00:14:26 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:26 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.info" returned: 0 in 0.631s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.118s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:26 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bdfe58c1-6453-468a-9a8e-6edad0d6b34a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Create snapshot completed successfully
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Flow 'volume_create_manager' (15e13f60-5fd8-4aca-9bdd-d19538bb869d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60a2ac5-7e74-4846-b8e3-3573545b4189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60a2ac5-7e74-4846-b8e3-3573545b4189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-149848975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e094937e-9679-408c-8739-f6d5243459b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a0568f4a7c4a1a888c3ecdaa3b0f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:28Z,use_quota=True,user_id='79cb86fbb4db4ccb9e9bb9b177caf3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7342f61e-2e42-4c6d-85dc-19a6a8cda4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7342f61e-2e42-4c6d-85dc-19a6a8cda4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8342556f-9098-4d01-8173-a8773d4e3167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8342556f-9098-4d01-8173-a8773d4e3167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e094937e-9679-408c-8739-f6d5243459b4', 'volume_name': 'volume-e094937e-9679-408c-8739-f6d5243459b4', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64628a4b-6533-4421-beaf-996fc60c7034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64628a4b-6533-4421-beaf-996fc60c7034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af76f113-6568-4111-aeba-dec73c188bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:28 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume e094937e-9679-408c-8739-f6d5243459b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e094937e-9679-408c-8739-f6d5243459b4', 'volume_size': 1}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-149848975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e094937e-9679-408c-8739-f6d5243459b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a0568f4a7c4a1a888c3ecdaa3b0f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:28Z,use_quota=True,user_id='79cb86fbb4db4ccb9e9bb9b177caf3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Creating volume e094937e-9679-408c-8739-f6d5243459b4 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:14:28 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e094937e-9679-408c-8739-f6d5243459b4 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:28 devstack sudo[104906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e094937e-9679-408c-8739-f6d5243459b4 1073741824
Jul 04 00:14:28 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Flow 'volume_create_manager' (75883f22-60ef-43bd-89e6-b7e1bc17cd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784859f0-a585-48da-8327-2be4bf88e514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (784859f0-a585-48da-8327-2be4bf88e514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-397555789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1babec-ba24-4989-9ab5-92b6b949c23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a0568f4a7c4a1a888c3ecdaa3b0f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:29Z,use_quota=True,user_id='79cb86fbb4db4ccb9e9bb9b177caf3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9d3294-f50d-489d-9763-e542f75f1c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd9d3294-f50d-489d-9763-e542f75f1c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70faff0c-bbeb-4888-a82e-a7215c5391ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70faff0c-bbeb-4888-a82e-a7215c5391ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1babec-ba24-4989-9ab5-92b6b949c23c', 'volume_name': 'volume-4e1babec-ba24-4989-9ab5-92b6b949c23c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01843d5c-38ec-4cf4-863c-a14ba7e881cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01843d5c-38ec-4cf4-863c-a14ba7e881cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be9b085-11af-4384-b799-b4045d70e604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:28 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume 4e1babec-ba24-4989-9ab5-92b6b949c23c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1babec-ba24-4989-9ab5-92b6b949c23c', 'volume_size': 1}
Jul 04 00:14:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Flow 'volume_create_manager' (926021dc-9a39-4c8f-add3-dc2f3e5fa323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebc8311-3a77-4278-845e-8203e757b1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ebc8311-3a77-4278-845e-8203e757b1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2105832747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8759dc-3c6f-4842-a278-472f970b0415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a0568f4a7c4a1a888c3ecdaa3b0f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:29Z,use_quota=True,user_id='79cb86fbb4db4ccb9e9bb9b177caf3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cde87e5-50b0-40d0-8712-f7687369c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cde87e5-50b0-40d0-8712-f7687369c59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0575415f-9d23-4add-b6ff-26106356503e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0575415f-9d23-4add-b6ff-26106356503e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d8759dc-3c6f-4842-a278-472f970b0415', 'volume_name': 'volume-0d8759dc-3c6f-4842-a278-472f970b0415', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21eb844-b535-464b-9abe-2e4a0fde0969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21eb844-b535-464b-9abe-2e4a0fde0969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e060803d-d047-461b-8902-579fb880774f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:29 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume 0d8759dc-3c6f-4842-a278-472f970b0415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d8759dc-3c6f-4842-a278-472f970b0415', 'volume_size': 1}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:29 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e094937e-9679-408c-8739-f6d5243459b4 1073741824" returned: 0 in 0.972s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e094937e-9679-408c-8739-f6d5243459b4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:29 devstack sudo[104912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e094937e-9679-408c-8739-f6d5243459b4
Jul 04 00:14:29 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Flow 'volume_create_manager' (436ccd14-b2f0-44d4-b1b5-5e81fdf29e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3385846e-163b-4c75-9b29-63381bcda8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3385846e-163b-4c75-9b29-63381bcda8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1850681540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54682c91-f76b-45c3-be4b-166e9403defc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a0568f4a7c4a1a888c3ecdaa3b0f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:30Z,use_quota=True,user_id='79cb86fbb4db4ccb9e9bb9b177caf3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fb5ef1-e183-48d5-a522-351257a81fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fb5ef1-e183-48d5-a522-351257a81fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e028fba-5981-42de-a0ea-0d3b21bca57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e028fba-5981-42de-a0ea-0d3b21bca57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54682c91-f76b-45c3-be4b-166e9403defc', 'volume_name': 'volume-54682c91-f76b-45c3-be4b-166e9403defc', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0401de50-8996-4043-85d3-08bed55b9187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0401de50-8996-4043-85d3-08bed55b9187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90705eef-fe76-475e-b1aa-97480abbb05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:29 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume 54682c91-f76b-45c3-be4b-166e9403defc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54682c91-f76b-45c3-be4b-166e9403defc', 'volume_size': 1}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Flow 'volume_create_manager' (dadcc9cb-cac9-4f11-8185-14a229675bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c048f13-5a30-46b9-b104-1a83fe05e924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c048f13-5a30-46b9-b104-1a83fe05e924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2081027715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c607a137-75a2-4330-b037-060fd85e2f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a0568f4a7c4a1a888c3ecdaa3b0f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:30Z,use_quota=True,user_id='79cb86fbb4db4ccb9e9bb9b177caf3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcd0232-aceb-4cee-92f0-d36f0a20ab11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fcd0232-aceb-4cee-92f0-d36f0a20ab11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e05acab-502b-486a-8d6d-5ba7bb804ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e05acab-502b-486a-8d6d-5ba7bb804ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c607a137-75a2-4330-b037-060fd85e2f13', 'volume_name': 'volume-c607a137-75a2-4330-b037-060fd85e2f13', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec44f7d-9b41-4aca-b452-31808c6d6003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec44f7d-9b41-4aca-b452-31808c6d6003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38894181-0138-4240-8650-efc67255bd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:30 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume c607a137-75a2-4330-b037-060fd85e2f13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c607a137-75a2-4330-b037-060fd85e2f13', 'volume_size': 1}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:30 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e094937e-9679-408c-8739-f6d5243459b4" returned: 0 in 0.661s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.240s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-397555789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1babec-ba24-4989-9ab5-92b6b949c23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a0568f4a7c4a1a888c3ecdaa3b0f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:29Z,use_quota=True,user_id='79cb86fbb4db4ccb9e9bb9b177caf3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Creating volume 4e1babec-ba24-4989-9ab5-92b6b949c23c {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:14:30 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4e1babec-ba24-4989-9ab5-92b6b949c23c 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af76f113-6568-4111-aeba-dec73c188bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e094937e-9679-408c-8739-f6d5243459b4', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:30 devstack sudo[104915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4e1babec-ba24-4989-9ab5-92b6b949c23c 1073741824
Jul 04 00:14:30 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913bedba-6ac6-47e9-aa1f-1519bf2ceb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:30 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume volume-e094937e-9679-408c-8739-f6d5243459b4 (e094937e-9679-408c-8739-f6d5243459b4): created successfully
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913bedba-6ac6-47e9-aa1f-1519bf2ceb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Flow 'volume_create_manager' (15e13f60-5fd8-4aca-9bdd-d19538bb869d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:14:30 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-8d8815af-368a-44ce-aca6-32f65614d264 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Created volume successfully.
Jul 04 00:14:31 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4e1babec-ba24-4989-9ab5-92b6b949c23c 1073741824" returned: 0 in 0.796s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4e1babec-ba24-4989-9ab5-92b6b949c23c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:31 devstack sudo[104921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4e1babec-ba24-4989-9ab5-92b6b949c23c
Jul 04 00:14:31 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:31 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4e1babec-ba24-4989-9ab5-92b6b949c23c" returned: 0 in 0.625s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.350s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2105832747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8759dc-3c6f-4842-a278-472f970b0415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a0568f4a7c4a1a888c3ecdaa3b0f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:29Z,use_quota=True,user_id='79cb86fbb4db4ccb9e9bb9b177caf3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Creating volume 0d8759dc-3c6f-4842-a278-472f970b0415 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:14:31 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0d8759dc-3c6f-4842-a278-472f970b0415 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:31 devstack sudo[104924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0d8759dc-3c6f-4842-a278-472f970b0415 1073741824
Jul 04 00:14:31 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4be9b085-11af-4384-b799-b4045d70e604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1babec-ba24-4989-9ab5-92b6b949c23c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c17113-bb4b-4b23-abc2-48f8aacb8856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:31 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume volume-4e1babec-ba24-4989-9ab5-92b6b949c23c (4e1babec-ba24-4989-9ab5-92b6b949c23c): created successfully
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1c17113-bb4b-4b23-abc2-48f8aacb8856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:31 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Flow 'volume_create_manager' (75883f22-60ef-43bd-89e6-b7e1bc17cd0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:14:31 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-1b18f9a6-6046-4c2f-8118-e6e2c5f96dca tempest-CreateVolumesFromSnapshotTest-1378112750 None] Created volume successfully.
Jul 04 00:14:32 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0d8759dc-3c6f-4842-a278-472f970b0415 1073741824" returned: 0 in 0.867s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0d8759dc-3c6f-4842-a278-472f970b0415 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:32 devstack sudo[104929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0d8759dc-3c6f-4842-a278-472f970b0415
Jul 04 00:14:32 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:33 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0d8759dc-3c6f-4842-a278-472f970b0415" returned: 0 in 0.635s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.503s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1850681540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54682c91-f76b-45c3-be4b-166e9403defc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a0568f4a7c4a1a888c3ecdaa3b0f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:30Z,use_quota=True,user_id='79cb86fbb4db4ccb9e9bb9b177caf3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Creating volume 54682c91-f76b-45c3-be4b-166e9403defc {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:14:33 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54682c91-f76b-45c3-be4b-166e9403defc 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e060803d-d047-461b-8902-579fb880774f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d8759dc-3c6f-4842-a278-472f970b0415', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:33 devstack sudo[104932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54682c91-f76b-45c3-be4b-166e9403defc 1073741824
Jul 04 00:14:33 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aa1f256-975b-423e-8181-87b9814a58ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:33 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume volume-0d8759dc-3c6f-4842-a278-472f970b0415 (0d8759dc-3c6f-4842-a278-472f970b0415): created successfully
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aa1f256-975b-423e-8181-87b9814a58ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:33 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Flow 'volume_create_manager' (926021dc-9a39-4c8f-add3-dc2f3e5fa323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:14:33 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-49429cd5-5b38-4d26-aba2-14190bb2a81a tempest-CreateVolumesFromSnapshotTest-1378112750 None] Created volume successfully.
Jul 04 00:14:34 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54682c91-f76b-45c3-be4b-166e9403defc 1073741824" returned: 0 in 0.862s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54682c91-f76b-45c3-be4b-166e9403defc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:34 devstack sudo[104938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54682c91-f76b-45c3-be4b-166e9403defc
Jul 04 00:14:34 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:34 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54682c91-f76b-45c3-be4b-166e9403defc" returned: 0 in 0.734s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] <== create_volume: return (1633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.812s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2081027715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c607a137-75a2-4330-b037-060fd85e2f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a0568f4a7c4a1a888c3ecdaa3b0f3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:30Z,use_quota=True,user_id='79cb86fbb4db4ccb9e9bb9b177caf3c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Creating volume c607a137-75a2-4330-b037-060fd85e2f13 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:14:34 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c607a137-75a2-4330-b037-060fd85e2f13 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:34 devstack sudo[104941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c607a137-75a2-4330-b037-060fd85e2f13 1073741824
Jul 04 00:14:34 devstack sudo[104941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90705eef-fe76-475e-b1aa-97480abbb05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54682c91-f76b-45c3-be4b-166e9403defc', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6798b57c-a1ff-4ab5-8302-7ae33ad46d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:34 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume volume-54682c91-f76b-45c3-be4b-166e9403defc (54682c91-f76b-45c3-be4b-166e9403defc): created successfully
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6798b57c-a1ff-4ab5-8302-7ae33ad46d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Flow 'volume_create_manager' (436ccd14-b2f0-44d4-b1b5-5e81fdf29e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:14:34 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-12bdf5f1-5283-4192-b09f-74c343999c61 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Created volume successfully.
Jul 04 00:14:35 devstack sudo[104941]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c607a137-75a2-4330-b037-060fd85e2f13 1073741824" returned: 0 in 0.815s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c607a137-75a2-4330-b037-060fd85e2f13 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:35 devstack sudo[104947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c607a137-75a2-4330-b037-060fd85e2f13
Jul 04 00:14:35 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:36 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c607a137-75a2-4330-b037-060fd85e2f13" returned: 0 in 0.686s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:14:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38894181-0138-4240-8650-efc67255bd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c607a137-75a2-4330-b037-060fd85e2f13', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac959a9-c3d6-4381-b92c-2e04f0fa695e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:36 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Volume volume-c607a137-75a2-4330-b037-060fd85e2f13 (c607a137-75a2-4330-b037-060fd85e2f13): created successfully
Jul 04 00:14:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac959a9-c3d6-4381-b92c-2e04f0fa695e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Flow 'volume_create_manager' (dadcc9cb-cac9-4f11-8185-14a229675bd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:14:36 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-70645503-9298-4bf2-9950-c6dc07da5e9f tempest-CreateVolumesFromSnapshotTest-1378112750 None] Created volume successfully.
Jul 04 00:14:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "cinder-c607a137-75a2-4330-b037-060fd85e2f13-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-c607a137-75a2-4330-b037-060fd85e2f13-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "cinder-quobyte-c607a137-75a2-4330-b037-060fd85e2f13" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-quobyte-c607a137-75a2-4330-b037-060fd85e2f13" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:37 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[780d859f-3890-4129-be82-3b8346ac89ed]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:14:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c607a137-75a2-4330-b037-060fd85e2f13 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:37 devstack sudo[104950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c607a137-75a2-4330-b037-060fd85e2f13
Jul 04 00:14:37 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:38 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c607a137-75a2-4330-b037-060fd85e2f13" returned: 0 in 0.795s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c607a137-75a2-4330-b037-060fd85e2f13 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:38 devstack sudo[104957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c607a137-75a2-4330-b037-060fd85e2f13
Jul 04 00:14:38 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:39 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-c607a137-75a2-4330-b037-060fd85e2f13" returned: 0 in 0.662s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-quobyte-c607a137-75a2-4330-b037-060fd85e2f13" released by "delete_volume" :: held 1.502s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Created reservations ['15c9c441-8dc0-42ed-9e33-37e9efacb4ec', 'e291dab0-a3d6-435f-8280-e04738e0b3df', '9380d256-88b0-4e53-94b2-0255428b2393', '111e9da8-f8bd-45f0-bdde-b75efaef85cf'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:39 devstack sudo[104960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:14:39 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "cinder-54682c91-f76b-45c3-be4b-166e9403defc-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-54682c91-f76b-45c3-be4b-166e9403defc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "cinder-quobyte-54682c91-f76b-45c3-be4b-166e9403defc" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-quobyte-54682c91-f76b-45c3-be4b-166e9403defc" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:39 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.689s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[05be2905-b799-4783-a0a1-62c1a74b25ac]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54682c91-f76b-45c3-be4b-166e9403defc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:39 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Deleted volume successfully.
Jul 04 00:14:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-59ba3f0c-7938-4478-a552-d65ffb6d44a7 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-c607a137-75a2-4330-b037-060fd85e2f13-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:40 devstack sudo[104963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54682c91-f76b-45c3-be4b-166e9403defc
Jul 04 00:14:40 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:40 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54682c91-f76b-45c3-be4b-166e9403defc" returned: 0 in 0.827s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54682c91-f76b-45c3-be4b-166e9403defc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:40 devstack sudo[104969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54682c91-f76b-45c3-be4b-166e9403defc
Jul 04 00:14:40 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:41 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54682c91-f76b-45c3-be4b-166e9403defc" returned: 0 in 0.643s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-quobyte-54682c91-f76b-45c3-be4b-166e9403defc" released by "delete_volume" :: held 1.526s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:41 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Created reservations ['049291c5-2ec8-445c-9091-4919cbbb5050', '2e5f5656-a5b5-4a1c-b7d7-dfc909aecfe3', '25768e4c-74ab-4d19-a682-573f91801a61', 'ec74db1b-5e89-48f5-8af7-8bb84f1c929c'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:14:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:41 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:14:41 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:14:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:41 devstack sudo[104972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:14:41 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "cinder-0d8759dc-3c6f-4842-a278-472f970b0415-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-0d8759dc-3c6f-4842-a278-472f970b0415-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "cinder-quobyte-0d8759dc-3c6f-4842-a278-472f970b0415" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-quobyte-0d8759dc-3c6f-4842-a278-472f970b0415" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:42 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[0811538f-e840-438f-8ba6-4b5fdcc5d3aa]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:14:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0d8759dc-3c6f-4842-a278-472f970b0415 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:42 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.665s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:42 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:14:42 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Deleted volume successfully.
Jul 04 00:14:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6c9e442f-ccdb-4886-9dd2-1b4f677c4471 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-54682c91-f76b-45c3-be4b-166e9403defc-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:42 devstack sudo[104975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0d8759dc-3c6f-4842-a278-472f970b0415
Jul 04 00:14:42 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:42 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0d8759dc-3c6f-4842-a278-472f970b0415" returned: 0 in 0.749s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0d8759dc-3c6f-4842-a278-472f970b0415 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:42 devstack sudo[104980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0d8759dc-3c6f-4842-a278-472f970b0415
Jul 04 00:14:42 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:43 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0d8759dc-3c6f-4842-a278-472f970b0415" returned: 0 in 0.611s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-quobyte-0d8759dc-3c6f-4842-a278-472f970b0415" released by "delete_volume" :: held 1.400s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:43 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Created reservations ['4bb17d1e-0f60-4d1d-9308-f86f30671590', 'df3a70ae-c3fb-4a63-a5ce-2b68cc465aeb', '482296f5-7f71-4f6d-8e56-0affe8c34109', '4fb3dd13-a535-4db3-9148-b1f84177963d'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:14:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:14:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:14:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:43 devstack sudo[104983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:14:43 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:44 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.642s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:44 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:14:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Deleted volume successfully.
Jul 04 00:14:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-37715e66-cf70-4600-ac27-90940686e69e tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-0d8759dc-3c6f-4842-a278-472f970b0415-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "cinder-4e1babec-ba24-4989-9ab5-92b6b949c23c-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-4e1babec-ba24-4989-9ab5-92b6b949c23c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "cinder-quobyte-4e1babec-ba24-4989-9ab5-92b6b949c23c" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-quobyte-4e1babec-ba24-4989-9ab5-92b6b949c23c" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:44 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9b8c8d-dc20-4bb3-8a13-fa0da00d6c63]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:14:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4e1babec-ba24-4989-9ab5-92b6b949c23c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:44 devstack sudo[104987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4e1babec-ba24-4989-9ab5-92b6b949c23c
Jul 04 00:14:44 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:45 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4e1babec-ba24-4989-9ab5-92b6b949c23c" returned: 0 in 0.751s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4e1babec-ba24-4989-9ab5-92b6b949c23c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:45 devstack sudo[104992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4e1babec-ba24-4989-9ab5-92b6b949c23c
Jul 04 00:14:45 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:45 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-4e1babec-ba24-4989-9ab5-92b6b949c23c" returned: 0 in 0.653s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-quobyte-4e1babec-ba24-4989-9ab5-92b6b949c23c" released by "delete_volume" :: held 1.442s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:45 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Created reservations ['ba7167e4-e3a4-4214-8300-d3e7c4c57ef2', '2f4dc91e-ff6c-4d20-83c6-0ae17bea5c43', 'e73d051c-3885-449e-89c3-66b8d6c810c0', '809b07fc-1a13-44bc-ba88-ab05121a2536'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:14:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:14:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:14:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:46 devstack sudo[104995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:14:46 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "cinder-e094937e-9679-408c-8739-f6d5243459b4-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-e094937e-9679-408c-8739-f6d5243459b4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:46 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.673s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:46 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:14:46 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Deleted volume successfully.
Jul 04 00:14:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "cinder-quobyte-e094937e-9679-408c-8739-f6d5243459b4" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-quobyte-e094937e-9679-408c-8739-f6d5243459b4" acquired by "delete_volume" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f544242f-5146-440c-b68a-183ab8129f55 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-4e1babec-ba24-4989-9ab5-92b6b949c23c-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:46 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a612b06-2a49-4037-87a8-7f77f0ed3f03]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:14:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e094937e-9679-408c-8739-f6d5243459b4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:46 devstack sudo[104998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e094937e-9679-408c-8739-f6d5243459b4
Jul 04 00:14:46 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:47 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e094937e-9679-408c-8739-f6d5243459b4" returned: 0 in 0.768s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e094937e-9679-408c-8739-f6d5243459b4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:47 devstack sudo[105003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e094937e-9679-408c-8739-f6d5243459b4
Jul 04 00:14:47 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:48 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e094937e-9679-408c-8739-f6d5243459b4" returned: 0 in 0.618s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-quobyte-e094937e-9679-408c-8739-f6d5243459b4" released by "delete_volume" :: held 1.426s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Created reservations ['1257f4a2-4f27-4416-ad5f-31182f00b7a3', 'a1925143-29a8-4d65-961f-3b2e8ef75d96', '4a9c7008-4a0a-4f72-9f3f-37e7c5ece2c6', '25253ddd-ba3e-47c8-a75e-38cef554b32a'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:48 devstack sudo[105006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:14:48 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "cinder-75038809-dbb7-4618-8fd0-e4fcbc489bfe-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-75038809-dbb7-4618-8fd0-e4fcbc489bfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "cinder-quobyte-74cfa0d8-360c-4e96-9b55-f3049c10496d" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-quobyte-74cfa0d8-360c-4e96-9b55-f3049c10496d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "cinder-quobyte-75038809-dbb7-4618-8fd0-e4fcbc489bfe" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-quobyte-75038809-dbb7-4618-8fd0-e4fcbc489bfe" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Deleting offline snapshot 75038809-dbb7-4618-8fd0-e4fcbc489bfe of volume 74cfa0d8-360c-4e96-9b55-f3049c10496d {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] snapshot_file for this snap is: volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df5e907-1efd-4652-aa53-6d84701cae11]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:48 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.711s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:14:48 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Deleted volume successfully.
Jul 04 00:14:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6da4010f-4194-453a-a9de-24db591a5723 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-e094937e-9679-408c-8739-f6d5243459b4-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:49 devstack sudo[105009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe
Jul 04 00:14:49 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:49 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe" returned: 0 in 0.762s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74cfa0d8-360c-4e96-9b55-f3049c10496d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:14:49 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6491006c-8b12-4050-876c-ea7ffe75baa9]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:14:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:49 devstack sudo[105014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d
Jul 04 00:14:49 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:50 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d" returned: 0 in 0.825s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:50 devstack sudo[105019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe
Jul 04 00:14:50 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:51 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe" returned: 0 in 0.759s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:51 devstack sudo[105024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe
Jul 04 00:14:51 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:51 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d.75038809-dbb7-4618-8fd0-e4fcbc489bfe" returned: 0 in 0.623s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:51 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-quobyte-75038809-dbb7-4618-8fd0-e4fcbc489bfe" released by "_delete_snapshot" :: held 3.076s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:51 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-quobyte-74cfa0d8-360c-4e96-9b55-f3049c10496d" released by "delete_snapshot" :: held 3.098s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:52 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Created reservations ['639d3de8-62f8-4592-93c3-995887a01ebe', 'e9859891-960b-496e-8daf-edb966e94f36', '60c80414-d6e1-4b0a-a4e8-f2fa93433b9b', '3f7e89f6-6495-413a-b13b-8dbe7390c508'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:14:52 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Delete snapshot completed successfully.
Jul 04 00:14:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d34fc66f-79d4-4af9-a242-166bb1ca6841 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-75038809-dbb7-4618-8fd0-e4fcbc489bfe-delete_snapshot" released by "delete_snapshot" :: held 3.241s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "cinder-74cfa0d8-360c-4e96-9b55-f3049c10496d-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-74cfa0d8-360c-4e96-9b55-f3049c10496d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "cinder-quobyte-74cfa0d8-360c-4e96-9b55-f3049c10496d" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:14:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-quobyte-74cfa0d8-360c-4e96-9b55-f3049c10496d" acquired by "delete_volume" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:14:53 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c89a9c-cf35-452a-a142-637af45d865b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:14:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:53 devstack sudo[105028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d
Jul 04 00:14:53 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:53 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d" returned: 0 in 0.769s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:53 devstack sudo[105033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d
Jul 04 00:14:53 devstack sudo[105033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:54 devstack sudo[105033]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-74cfa0d8-360c-4e96-9b55-f3049c10496d" returned: 0 in 0.648s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-quobyte-74cfa0d8-360c-4e96-9b55-f3049c10496d" released by "delete_volume" :: held 1.477s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:54 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Created reservations ['8063ad06-6d35-48b5-931b-fdff9410f60c', '05c7eed8-6d00-4a5f-86b3-d6643619097b', 'f901abb5-9149-451d-9db4-0e45293a8424', '3856b637-3d91-4bee-af29-db98ef044291'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:14:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:14:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:14:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:54 devstack sudo[105037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:14:54 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:55 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.638s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:55 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:14:55 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Deleted volume successfully.
Jul 04 00:14:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-08d8b78e-cee2-4d74-878e-ec1c5470f654 tempest-CreateVolumesFromSnapshotTest-1378112750 None] Lock "cinder-74cfa0d8-360c-4e96-9b55-f3049c10496d-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Flow 'volume_create_manager' (2050e130-6e55-4ced-aa37-05d29e93c6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdc1a89-aec6-4235-a86f-928cc4729ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebdc1a89-aec6-4235-a86f-928cc4729ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1522404970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70938d47-96bf-4e82-86b5-8cd393b19ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5561d982e6d54ab2a577353147f90f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:58Z,use_quota=True,user_id='082f57b1e2ce4c9da9756434647035ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ccaf91-9335-47c3-85d9-746a3213c788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ccaf91-9335-47c3-85d9-746a3213c788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed6930c-fcf0-4d0d-b739-a14ea774d0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fed6930c-fcf0-4d0d-b739-a14ea774d0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70938d47-96bf-4e82-86b5-8cd393b19ed7', 'volume_name': 'volume-70938d47-96bf-4e82-86b5-8cd393b19ed7', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2171ee-189f-4b78-8807-65cae453346f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe2171ee-189f-4b78-8807-65cae453346f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588c23fb-b131-4cd1-b864-d581215258e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:58 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume 70938d47-96bf-4e82-86b5-8cd393b19ed7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70938d47-96bf-4e82-86b5-8cd393b19ed7', 'volume_size': 1}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:14:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1522404970',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70938d47-96bf-4e82-86b5-8cd393b19ed7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5561d982e6d54ab2a577353147f90f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:14:58Z,use_quota=True,user_id='082f57b1e2ce4c9da9756434647035ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Creating volume 70938d47-96bf-4e82-86b5-8cd393b19ed7 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:14:58 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-70938d47-96bf-4e82-86b5-8cd393b19ed7 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:58 devstack sudo[105082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-70938d47-96bf-4e82-86b5-8cd393b19ed7 1073741824
Jul 04 00:14:58 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:58 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-70938d47-96bf-4e82-86b5-8cd393b19ed7 1073741824" returned: 0 in 0.789s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-70938d47-96bf-4e82-86b5-8cd393b19ed7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:14:59 devstack sudo[105087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-70938d47-96bf-4e82-86b5-8cd393b19ed7
Jul 04 00:14:59 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:14:59 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root
Jul 04 00:14:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-70938d47-96bf-4e82-86b5-8cd393b19ed7" returned: 0 in 0.635s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:14:59 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:14:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:14:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (588c23fb-b131-4cd1-b864-d581215258e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70938d47-96bf-4e82-86b5-8cd393b19ed7', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c993c58-273e-4dc5-bb33-a8db0f7c3e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:14:59 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume volume-70938d47-96bf-4e82-86b5-8cd393b19ed7 (70938d47-96bf-4e82-86b5-8cd393b19ed7): created successfully
Jul 04 00:14:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c993c58-273e-4dc5-bb33-a8db0f7c3e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:14:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Flow 'volume_create_manager' (2050e130-6e55-4ced-aa37-05d29e93c6e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:14:59 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-90fa5e40-3265-4e85-9b8d-fbfd4c8e4ef2 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Created volume successfully.
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Flow 'volume_create_manager' (ac259f07-8c7a-4949-9a90-e8e22c2a6478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb8f32c-37b3-486e-96c1-fe51c409a475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb8f32c-37b3-486e-96c1-fe51c409a475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1567342590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d9658d-1c7b-4c22-b3cf-b083742efde9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5561d982e6d54ab2a577353147f90f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:01Z,use_quota=True,user_id='082f57b1e2ce4c9da9756434647035ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cb44f9-8d2c-4d5c-b701-f5e0140b8920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cb44f9-8d2c-4d5c-b701-f5e0140b8920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f32d21-068b-4a8e-bbfb-64a4477c9053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f32d21-068b-4a8e-bbfb-64a4477c9053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3d9658d-1c7b-4c22-b3cf-b083742efde9', 'volume_name': 'volume-a3d9658d-1c7b-4c22-b3cf-b083742efde9', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcbaacdb-a533-43a0-bdea-a968e4145491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcbaacdb-a533-43a0-bdea-a968e4145491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce0301c-2288-44e0-a2bc-a25fed523932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:00 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume a3d9658d-1c7b-4c22-b3cf-b083742efde9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3d9658d-1c7b-4c22-b3cf-b083742efde9', 'volume_size': 1}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1567342590',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d9658d-1c7b-4c22-b3cf-b083742efde9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5561d982e6d54ab2a577353147f90f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:01Z,use_quota=True,user_id='082f57b1e2ce4c9da9756434647035ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Creating volume a3d9658d-1c7b-4c22-b3cf-b083742efde9 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:15:00 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:15:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a3d9658d-1c7b-4c22-b3cf-b083742efde9 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:00 devstack sudo[105090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a3d9658d-1c7b-4c22-b3cf-b083742efde9 1073741824
Jul 04 00:15:00 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Flow 'volume_create_manager' (c80aa2ef-dc83-4395-80cd-cf99e99db62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7f02ae-1715-4eaa-bdf1-d2ef974eb30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7f02ae-1715-4eaa-bdf1-d2ef974eb30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-403994739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3aaf4f-58b6-41e1-9c8f-b618042d6725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5561d982e6d54ab2a577353147f90f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:01Z,use_quota=True,user_id='082f57b1e2ce4c9da9756434647035ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce6a543-6a14-4cb2-9498-223a88877575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bce6a543-6a14-4cb2-9498-223a88877575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0ea7db-cc0b-40a5-874d-fc4c068bbc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae0ea7db-cc0b-40a5-874d-fc4c068bbc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd3aaf4f-58b6-41e1-9c8f-b618042d6725', 'volume_name': 'volume-cd3aaf4f-58b6-41e1-9c8f-b618042d6725', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc83949a-9df9-4199-8a09-a2f907b81a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc83949a-9df9-4199-8a09-a2f907b81a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d84c50f-f09e-499e-ab22-bfe592ff8dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:01 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume cd3aaf4f-58b6-41e1-9c8f-b618042d6725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd3aaf4f-58b6-41e1-9c8f-b618042d6725', 'volume_size': 1}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Flow 'volume_create_manager' (0571a567-27ad-413d-bb58-91b37f10940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480d5ebc-0258-4172-8935-10e3cdf6eb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480d5ebc-0258-4172-8935-10e3cdf6eb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-805231253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51db2b5c-a999-470f-a627-2ca2fb8abff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5561d982e6d54ab2a577353147f90f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:01Z,use_quota=True,user_id='082f57b1e2ce4c9da9756434647035ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d83bae7-ae1a-4c27-a12c-dbf0b7e8bd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d83bae7-ae1a-4c27-a12c-dbf0b7e8bd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f1b58fd-b95c-4094-87ce-daf466ea26f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f1b58fd-b95c-4094-87ce-daf466ea26f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51db2b5c-a999-470f-a627-2ca2fb8abff1', 'volume_name': 'volume-51db2b5c-a999-470f-a627-2ca2fb8abff1', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb950743-fe5c-4ca9-98a1-734f9a269041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb950743-fe5c-4ca9-98a1-734f9a269041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8034fa-1feb-4351-a736-53658cbf0937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:01 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume 51db2b5c-a999-470f-a627-2ca2fb8abff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51db2b5c-a999-470f-a627-2ca2fb8abff1', 'volume_size': 1}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:01 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a3d9658d-1c7b-4c22-b3cf-b083742efde9 1073741824" returned: 0 in 0.954s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Flow 'volume_create_manager' (9f524444-a3d3-409d-b403-03c57b1cdfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a143c8a-b6ba-43f3-b2d9-aac5566aa921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a3d9658d-1c7b-4c22-b3cf-b083742efde9 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a143c8a-b6ba-43f3-b2d9-aac5566aa921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-800273658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b64ec7-9452-4cb5-ac8d-029d14624373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5561d982e6d54ab2a577353147f90f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:02Z,use_quota=True,user_id='082f57b1e2ce4c9da9756434647035ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:01 devstack sudo[105098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a3d9658d-1c7b-4c22-b3cf-b083742efde9
Jul 04 00:15:01 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375607b1-e936-46bf-88d4-18b7e54960a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375607b1-e936-46bf-88d4-18b7e54960a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa729150-b6e7-446d-b32c-ebb4c862c414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa729150-b6e7-446d-b32c-ebb4c862c414) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7b64ec7-9452-4cb5-ac8d-029d14624373', 'volume_name': 'volume-a7b64ec7-9452-4cb5-ac8d-029d14624373', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e843a0a3-354b-4eb0-8e3d-e29753ca9800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e843a0a3-354b-4eb0-8e3d-e29753ca9800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cdad831-74ee-4959-8a22-a6f5ad2abb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:01 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume a7b64ec7-9452-4cb5-ac8d-029d14624373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7b64ec7-9452-4cb5-ac8d-029d14624373', 'volume_size': 1}
Jul 04 00:15:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Flow 'volume_create_manager' (3b728ff1-80da-4078-9f8a-a6a78aad4947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45a6d51-80f0-487e-8443-6e96ce2e15d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45a6d51-80f0-487e-8443-6e96ce2e15d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-770026306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54805e41-e184-44c8-a3e9-2d8bfd47de43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5561d982e6d54ab2a577353147f90f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:02Z,use_quota=True,user_id='082f57b1e2ce4c9da9756434647035ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8decfd-48cd-4c4a-927e-0978710efb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c8decfd-48cd-4c4a-927e-0978710efb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc63a817-05a0-4520-98c7-4122f360f6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc63a817-05a0-4520-98c7-4122f360f6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54805e41-e184-44c8-a3e9-2d8bfd47de43', 'volume_name': 'volume-54805e41-e184-44c8-a3e9-2d8bfd47de43', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdde86a8-6bf6-4342-aa3d-3e374778d57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdde86a8-6bf6-4342-aa3d-3e374778d57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e5dc8a-1356-41a8-85b2-7a8f73555dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:02 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume 54805e41-e184-44c8-a3e9-2d8bfd47de43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54805e41-e184-44c8-a3e9-2d8bfd47de43', 'volume_size': 1}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:02 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a3d9658d-1c7b-4c22-b3cf-b083742efde9" returned: 0 in 0.722s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.415s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-403994739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3aaf4f-58b6-41e1-9c8f-b618042d6725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5561d982e6d54ab2a577353147f90f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:01Z,use_quota=True,user_id='082f57b1e2ce4c9da9756434647035ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Creating volume cd3aaf4f-58b6-41e1-9c8f-b618042d6725 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:15:02 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cd3aaf4f-58b6-41e1-9c8f-b618042d6725 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:02 devstack sudo[105101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cd3aaf4f-58b6-41e1-9c8f-b618042d6725 1073741824
Jul 04 00:15:02 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ce0301c-2288-44e0-a2bc-a25fed523932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d9658d-1c7b-4c22-b3cf-b083742efde9', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39b7608-8d92-484f-94fc-c036a2b13c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:02 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume volume-a3d9658d-1c7b-4c22-b3cf-b083742efde9 (a3d9658d-1c7b-4c22-b3cf-b083742efde9): created successfully
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a39b7608-8d92-484f-94fc-c036a2b13c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Flow 'volume_create_manager' (ac259f07-8c7a-4949-9a90-e8e22c2a6478) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:02 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-217ac611-428c-4eeb-9165-d0afee4abdbb tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Created volume successfully.
Jul 04 00:15:03 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cd3aaf4f-58b6-41e1-9c8f-b618042d6725 1073741824" returned: 0 in 0.867s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cd3aaf4f-58b6-41e1-9c8f-b618042d6725 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:03 devstack sudo[105107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cd3aaf4f-58b6-41e1-9c8f-b618042d6725
Jul 04 00:15:03 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:04 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cd3aaf4f-58b6-41e1-9c8f-b618042d6725" returned: 0 in 0.681s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.644s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-805231253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51db2b5c-a999-470f-a627-2ca2fb8abff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5561d982e6d54ab2a577353147f90f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:01Z,use_quota=True,user_id='082f57b1e2ce4c9da9756434647035ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Creating volume 51db2b5c-a999-470f-a627-2ca2fb8abff1 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:15:04 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51db2b5c-a999-470f-a627-2ca2fb8abff1 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d84c50f-f09e-499e-ab22-bfe592ff8dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd3aaf4f-58b6-41e1-9c8f-b618042d6725', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:04 devstack sudo[105111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51db2b5c-a999-470f-a627-2ca2fb8abff1 1073741824
Jul 04 00:15:04 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab52c6ca-5c7c-4079-bfe1-83c08bc56e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:04 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume volume-cd3aaf4f-58b6-41e1-9c8f-b618042d6725 (cd3aaf4f-58b6-41e1-9c8f-b618042d6725): created successfully
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab52c6ca-5c7c-4079-bfe1-83c08bc56e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Flow 'volume_create_manager' (c80aa2ef-dc83-4395-80cd-cf99e99db62e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:04 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-41351d47-a9da-416b-a462-edd4446df312 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Created volume successfully.
Jul 04 00:15:04 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51db2b5c-a999-470f-a627-2ca2fb8abff1 1073741824" returned: 0 in 0.852s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51db2b5c-a999-470f-a627-2ca2fb8abff1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:05 devstack sudo[105117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51db2b5c-a999-470f-a627-2ca2fb8abff1
Jul 04 00:15:05 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:05 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51db2b5c-a999-470f-a627-2ca2fb8abff1" returned: 0 in 0.687s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.838s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-800273658',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b64ec7-9452-4cb5-ac8d-029d14624373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5561d982e6d54ab2a577353147f90f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:02Z,use_quota=True,user_id='082f57b1e2ce4c9da9756434647035ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Creating volume a7b64ec7-9452-4cb5-ac8d-029d14624373 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:15:05 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7b64ec7-9452-4cb5-ac8d-029d14624373 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8034fa-1feb-4351-a736-53658cbf0937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51db2b5c-a999-470f-a627-2ca2fb8abff1', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:05 devstack sudo[105120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7b64ec7-9452-4cb5-ac8d-029d14624373 1073741824
Jul 04 00:15:05 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5534ecff-2f64-4047-b6d1-a32b59d0bc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:05 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume volume-51db2b5c-a999-470f-a627-2ca2fb8abff1 (51db2b5c-a999-470f-a627-2ca2fb8abff1): created successfully
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5534ecff-2f64-4047-b6d1-a32b59d0bc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Flow 'volume_create_manager' (0571a567-27ad-413d-bb58-91b37f10940c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:05 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-67896ab5-0868-40fc-9376-be0dd2c4a262 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Created volume successfully.
Jul 04 00:15:06 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7b64ec7-9452-4cb5-ac8d-029d14624373 1073741824" returned: 0 in 0.818s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7b64ec7-9452-4cb5-ac8d-029d14624373 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:06 devstack sudo[105125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7b64ec7-9452-4cb5-ac8d-029d14624373
Jul 04 00:15:06 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:07 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7b64ec7-9452-4cb5-ac8d-029d14624373" returned: 0 in 0.642s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.961s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-770026306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54805e41-e184-44c8-a3e9-2d8bfd47de43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5561d982e6d54ab2a577353147f90f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:02Z,use_quota=True,user_id='082f57b1e2ce4c9da9756434647035ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Creating volume 54805e41-e184-44c8-a3e9-2d8bfd47de43 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:15:07 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54805e41-e184-44c8-a3e9-2d8bfd47de43 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cdad831-74ee-4959-8a22-a6f5ad2abb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7b64ec7-9452-4cb5-ac8d-029d14624373', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:07 devstack sudo[105128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54805e41-e184-44c8-a3e9-2d8bfd47de43 1073741824
Jul 04 00:15:07 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ace17c1-f62f-4a05-9ea9-159068ff1f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:07 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume volume-a7b64ec7-9452-4cb5-ac8d-029d14624373 (a7b64ec7-9452-4cb5-ac8d-029d14624373): created successfully
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ace17c1-f62f-4a05-9ea9-159068ff1f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Flow 'volume_create_manager' (9f524444-a3d3-409d-b403-03c57b1cdfd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:07 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f3afff95-1a82-4788-894e-9ec6a6466075 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Created volume successfully.
Jul 04 00:15:08 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54805e41-e184-44c8-a3e9-2d8bfd47de43 1073741824" returned: 0 in 0.786s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54805e41-e184-44c8-a3e9-2d8bfd47de43 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:08 devstack sudo[105133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54805e41-e184-44c8-a3e9-2d8bfd47de43
Jul 04 00:15:08 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:08 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54805e41-e184-44c8-a3e9-2d8bfd47de43" returned: 0 in 0.614s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:15:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80e5dc8a-1356-41a8-85b2-7a8f73555dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54805e41-e184-44c8-a3e9-2d8bfd47de43', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (377e3724-fc3c-4a89-8ed3-b07ea47f2cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:08 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Volume volume-54805e41-e184-44c8-a3e9-2d8bfd47de43 (54805e41-e184-44c8-a3e9-2d8bfd47de43): created successfully
Jul 04 00:15:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (377e3724-fc3c-4a89-8ed3-b07ea47f2cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Flow 'volume_create_manager' (3b728ff1-80da-4078-9f8a-a6a78aad4947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:08 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-85c12a0f-698d-478e-8a16-c24d8c509438 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Created volume successfully.
Jul 04 00:15:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "cinder-54805e41-e184-44c8-a3e9-2d8bfd47de43-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-54805e41-e184-44c8-a3e9-2d8bfd47de43-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "cinder-quobyte-54805e41-e184-44c8-a3e9-2d8bfd47de43" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-quobyte-54805e41-e184-44c8-a3e9-2d8bfd47de43" acquired by "delete_volume" :: waited 0.014s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:09 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50bf374-0342-47c1-b7fa-03bec770e932]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54805e41-e184-44c8-a3e9-2d8bfd47de43 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:09 devstack sudo[105136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54805e41-e184-44c8-a3e9-2d8bfd47de43
Jul 04 00:15:09 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:10 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54805e41-e184-44c8-a3e9-2d8bfd47de43" returned: 0 in 0.765s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54805e41-e184-44c8-a3e9-2d8bfd47de43 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:10 devstack sudo[105141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54805e41-e184-44c8-a3e9-2d8bfd47de43
Jul 04 00:15:10 devstack sudo[105141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:11 devstack sudo[105141]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-54805e41-e184-44c8-a3e9-2d8bfd47de43" returned: 0 in 0.630s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-quobyte-54805e41-e184-44c8-a3e9-2d8bfd47de43" released by "delete_volume" :: held 1.438s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:11 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Created reservations ['66acc261-4f44-4894-afd2-fc12e44937c7', '4ad42733-057a-48cd-b844-31f18bfb9c2d', '14f6dd67-82a2-4ada-b5f4-ca7fa80136d7', 'a50cf50b-101e-4ed6-82dc-b0ec37725dab'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:15:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:11 devstack sudo[105144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:15:11 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "cinder-a7b64ec7-9452-4cb5-ac8d-029d14624373-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:12 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-a7b64ec7-9452-4cb5-ac8d-029d14624373-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.642s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:12 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:15:12 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Deleted volume successfully.
Jul 04 00:15:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-45857f0c-bc1d-4796-9770-cf01e30866a3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-54805e41-e184-44c8-a3e9-2d8bfd47de43-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "cinder-quobyte-a7b64ec7-9452-4cb5-ac8d-029d14624373" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-quobyte-a7b64ec7-9452-4cb5-ac8d-029d14624373" acquired by "delete_volume" :: waited 0.014s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:12 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8de0984-d198-4a29-bb46-2faca79dd358]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7b64ec7-9452-4cb5-ac8d-029d14624373 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:12 devstack sudo[105147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7b64ec7-9452-4cb5-ac8d-029d14624373
Jul 04 00:15:12 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:12 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7b64ec7-9452-4cb5-ac8d-029d14624373" returned: 0 in 0.741s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7b64ec7-9452-4cb5-ac8d-029d14624373 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:12 devstack sudo[105152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7b64ec7-9452-4cb5-ac8d-029d14624373
Jul 04 00:15:12 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:13 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7b64ec7-9452-4cb5-ac8d-029d14624373" returned: 0 in 0.630s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-quobyte-a7b64ec7-9452-4cb5-ac8d-029d14624373" released by "delete_volume" :: held 1.408s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:13 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Created reservations ['bb983c52-ab6d-4b2b-9c81-ebc2e3df2113', 'e1dde075-922c-488c-997e-2b78fe6987bf', '0bd758ff-f061-40a9-8056-c5a788b99ef0', 'd2844029-48c7-4699-a0cf-27b33b81d4d2'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:15:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:13 devstack sudo[105155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:15:13 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:14 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.614s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:14 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:15:14 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Deleted volume successfully.
Jul 04 00:15:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "cinder-51db2b5c-a999-470f-a627-2ca2fb8abff1-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-2fa61e35-9a07-4192-9ff2-6ff0eecfb6ed tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-a7b64ec7-9452-4cb5-ac8d-029d14624373-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-51db2b5c-a999-470f-a627-2ca2fb8abff1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "cinder-quobyte-51db2b5c-a999-470f-a627-2ca2fb8abff1" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-quobyte-51db2b5c-a999-470f-a627-2ca2fb8abff1" acquired by "delete_volume" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:14 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f20a30-73fc-41e3-bf07-0ddeabb9ffe3]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51db2b5c-a999-470f-a627-2ca2fb8abff1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:15:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:14 devstack sudo[105159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51db2b5c-a999-470f-a627-2ca2fb8abff1
Jul 04 00:15:14 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:14 devstack sudo[105161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:15:14 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:15 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.617s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:15:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:15:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:15:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:15:15 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51db2b5c-a999-470f-a627-2ca2fb8abff1" returned: 0 in 0.754s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51db2b5c-a999-470f-a627-2ca2fb8abff1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:15 devstack sudo[105167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51db2b5c-a999-470f-a627-2ca2fb8abff1
Jul 04 00:15:15 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:15 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-51db2b5c-a999-470f-a627-2ca2fb8abff1" returned: 0 in 0.609s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-quobyte-51db2b5c-a999-470f-a627-2ca2fb8abff1" released by "delete_volume" :: held 1.400s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:15 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Created reservations ['81631cb5-2be4-40e3-bf17-a07e9370b136', '89898529-4c96-4e3c-8071-81f315f1eee4', '6f2772f4-ffe9-4101-9bc2-a9547ca03661', '23148224-f7a0-4314-8e4f-c728a2e605fd'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:15:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:15 devstack sudo[105170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:15:15 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "cinder-cd3aaf4f-58b6-41e1-9c8f-b618042d6725-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-cd3aaf4f-58b6-41e1-9c8f-b618042d6725-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:16 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.702s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:16 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:15:16 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Deleted volume successfully.
Jul 04 00:15:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "cinder-quobyte-cd3aaf4f-58b6-41e1-9c8f-b618042d6725" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-90e03c54-f3ab-4793-9383-9bccd2048f52 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-51db2b5c-a999-470f-a627-2ca2fb8abff1-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-quobyte-cd3aaf4f-58b6-41e1-9c8f-b618042d6725" acquired by "delete_volume" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:16 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab4289c-d63b-4c63-93c0-de6db189ef3e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cd3aaf4f-58b6-41e1-9c8f-b618042d6725 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:16 devstack sudo[105173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cd3aaf4f-58b6-41e1-9c8f-b618042d6725
Jul 04 00:15:16 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:17 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cd3aaf4f-58b6-41e1-9c8f-b618042d6725" returned: 0 in 0.746s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cd3aaf4f-58b6-41e1-9c8f-b618042d6725 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:17 devstack sudo[105178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cd3aaf4f-58b6-41e1-9c8f-b618042d6725
Jul 04 00:15:17 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:18 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cd3aaf4f-58b6-41e1-9c8f-b618042d6725" returned: 0 in 0.656s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-quobyte-cd3aaf4f-58b6-41e1-9c8f-b618042d6725" released by "delete_volume" :: held 1.445s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Created reservations ['d872e483-3fd0-4f1c-b00b-92d03adcc8d5', 'ca9e65b3-0c10-4bfe-bf2b-631f700f103e', '83057ca5-45de-4700-898a-72b3b8ed2e33', 'dd935b52-5eb3-4398-87a8-f086101043d2'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:18 devstack sudo[105181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:15:18 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "cinder-a3d9658d-1c7b-4c22-b3cf-b083742efde9-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-a3d9658d-1c7b-4c22-b3cf-b083742efde9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "cinder-quobyte-a3d9658d-1c7b-4c22-b3cf-b083742efde9" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-quobyte-a3d9658d-1c7b-4c22-b3cf-b083742efde9" acquired by "delete_volume" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:18 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.690s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:15:18 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Deleted volume successfully.
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6644c37f-837d-49d0-8817-4e4cc1d3d347]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a3d9658d-1c7b-4c22-b3cf-b083742efde9 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c8c57d4f-26f1-4a36-b9b8-191ad3876794 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-cd3aaf4f-58b6-41e1-9c8f-b618042d6725-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:18 devstack sudo[105184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a3d9658d-1c7b-4c22-b3cf-b083742efde9
Jul 04 00:15:18 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:19 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a3d9658d-1c7b-4c22-b3cf-b083742efde9" returned: 0 in 0.762s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a3d9658d-1c7b-4c22-b3cf-b083742efde9 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:19 devstack sudo[105189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a3d9658d-1c7b-4c22-b3cf-b083742efde9
Jul 04 00:15:19 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:20 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a3d9658d-1c7b-4c22-b3cf-b083742efde9" returned: 0 in 0.627s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-quobyte-a3d9658d-1c7b-4c22-b3cf-b083742efde9" released by "delete_volume" :: held 1.435s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:20 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=78,cinder:UPDATE=121,cinder:INSERT=27,cinder:DELETE=14 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:15:20 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=92,cinder:UPDATE=126,cinder:DELETE=9,cinder:INSERT=30 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:15:20 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Created reservations ['32bfa656-fde9-4a87-94c1-f211035a8554', 'b63abe51-cd40-4738-8cdc-f335cbf051e0', 'c1d8810f-3226-4eb1-bca9-a1f7edcb50eb', '670e7f6b-09fe-4d20-b218-fa825d8f7c3d'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:15:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:20 devstack sudo[105192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:15:20 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "cinder-70938d47-96bf-4e82-86b5-8cd393b19ed7-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:21 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-70938d47-96bf-4e82-86b5-8cd393b19ed7-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.694s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:21 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:15:21 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Deleted volume successfully.
Jul 04 00:15:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ca39c253-4bd9-41bb-a39a-f4615d479f61 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-a3d9658d-1c7b-4c22-b3cf-b083742efde9-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "cinder-quobyte-70938d47-96bf-4e82-86b5-8cd393b19ed7" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-quobyte-70938d47-96bf-4e82-86b5-8cd393b19ed7" acquired by "delete_volume" :: waited 0.013s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:21 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[37372c80-757c-460f-a541-1c3dd4304a8b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-70938d47-96bf-4e82-86b5-8cd393b19ed7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:21 devstack sudo[105195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-70938d47-96bf-4e82-86b5-8cd393b19ed7
Jul 04 00:15:21 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:21 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-70938d47-96bf-4e82-86b5-8cd393b19ed7" returned: 0 in 0.795s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-70938d47-96bf-4e82-86b5-8cd393b19ed7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:21 devstack sudo[105200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-70938d47-96bf-4e82-86b5-8cd393b19ed7
Jul 04 00:15:21 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:22 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-70938d47-96bf-4e82-86b5-8cd393b19ed7" returned: 0 in 0.637s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-quobyte-70938d47-96bf-4e82-86b5-8cd393b19ed7" released by "delete_volume" :: held 1.469s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:22 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Created reservations ['a9124d87-3fa1-414e-9eab-26c7464b7b4d', '746e9515-bfb3-496b-88c2-962c08d2ff5c', '3de7a0ff-c188-4e10-b0d6-42ed33a8e8e5', 'd5093c21-147a-4254-8935-7baddd4b872c'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:15:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:22 devstack sudo[105203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:15:22 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:23 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.627s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:23 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:15:23 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Deleted volume successfully.
Jul 04 00:15:23 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-a1484458-9051-41ab-9f64-fb46c164f0b3 tempest-CreateVolumesFromSourceVolumeTest-1324343298 None] Lock "cinder-70938d47-96bf-4e82-86b5-8cd393b19ed7-delete_volume" released by "delete_volume" :: held 2.290s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:32 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:INSERT=5,cinder:UPDATE=15,cinder:SELECT=7 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:15:33 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=16,cinder:DELETE=2 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:15:34 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:15:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Flow 'volume_create_manager' (031b6f64-717f-4ad7-86be-b46352589484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:34 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422da75e-b2a5-42d0-b22a-564ddf6c119a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422da75e-b2a5-42d0-b22a-564ddf6c119a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1724815560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f5deff-e313-4e33-ac3a-09a277555164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9e1897dac4f599e4ec256965b7ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:35Z,use_quota=True,user_id='022897e1a1a74bdfa4fb6e331fb9766b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bfea63-f495-4434-bd29-daaa12b3c64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0bfea63-f495-4434-bd29-daaa12b3c64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6317c8d1-3076-4e62-841f-0ec765918267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6317c8d1-3076-4e62-841f-0ec765918267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30f5deff-e313-4e33-ac3a-09a277555164', 'volume_name': 'volume-30f5deff-e313-4e33-ac3a-09a277555164', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd9638f-f91b-48d7-b280-311e4e0b000d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bd9638f-f91b-48d7-b280-311e4e0b000d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83bab8b-1671-4898-aea7-f8d9c7bf1f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:35 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Volume 30f5deff-e313-4e33-ac3a-09a277555164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30f5deff-e313-4e33-ac3a-09a277555164', 'volume_size': 1}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1724815560',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f5deff-e313-4e33-ac3a-09a277555164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9e1897dac4f599e4ec256965b7ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:35Z,use_quota=True,user_id='022897e1a1a74bdfa4fb6e331fb9766b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Creating volume 30f5deff-e313-4e33-ac3a-09a277555164 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:15:35 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:15:35 devstack sudo[105246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164 1073741824
Jul 04 00:15:35 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Flow 'volume_create_manager' (8c2913e5-640f-42c1-be1a-550423f6c8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5500f04d-a38b-41fb-b997-174e1c254d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5500f04d-a38b-41fb-b997-174e1c254d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1387706545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846160af-053c-4e4d-b235-8082ab80054b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eee5923835d44ee49facff3e28132138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:35Z,use_quota=True,user_id='67f366820f8c4578a5ad5b91d91b0dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77fc1e30-94d7-462d-a072-647e85df8ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77fc1e30-94d7-462d-a072-647e85df8ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d70674d-e87c-44f1-af4c-90ac088d6aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d70674d-e87c-44f1-af4c-90ac088d6aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846160af-053c-4e4d-b235-8082ab80054b', 'volume_name': 'volume-846160af-053c-4e4d-b235-8082ab80054b', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce731436-79aa-4c4e-a5cb-e5dacd81fb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce731436-79aa-4c4e-a5cb-e5dacd81fb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5122ae4-762d-41ec-a336-79f483ab6a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:35 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume 846160af-053c-4e4d-b235-8082ab80054b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846160af-053c-4e4d-b235-8082ab80054b', 'volume_size': 1}
Jul 04 00:15:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:36 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164 1073741824" returned: 0 in 1.018s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:36 devstack sudo[105253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164
Jul 04 00:15:36 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:36 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164" returned: 0 in 0.652s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.589s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1387706545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846160af-053c-4e4d-b235-8082ab80054b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eee5923835d44ee49facff3e28132138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:35Z,use_quota=True,user_id='67f366820f8c4578a5ad5b91d91b0dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Creating volume 846160af-053c-4e4d-b235-8082ab80054b {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:15:36 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-846160af-053c-4e4d-b235-8082ab80054b 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:36 devstack sudo[105256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-846160af-053c-4e4d-b235-8082ab80054b 1073741824
Jul 04 00:15:36 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b83bab8b-1671-4898-aea7-f8d9c7bf1f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f5deff-e313-4e33-ac3a-09a277555164', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863a4b15-3f91-4d9b-89b7-a3380052719d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:36 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Volume volume-30f5deff-e313-4e33-ac3a-09a277555164 (30f5deff-e313-4e33-ac3a-09a277555164): created successfully
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863a4b15-3f91-4d9b-89b7-a3380052719d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Flow 'volume_create_manager' (031b6f64-717f-4ad7-86be-b46352589484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:36 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-94a8650f-eee3-44a4-bd9f-eee95d8dcf37 tempest-VolumeDependencyTests-193571950 None] Created volume successfully.
Jul 04 00:15:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:37 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-846160af-053c-4e4d-b235-8082ab80054b 1073741824" returned: 0 in 1.053s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-846160af-053c-4e4d-b235-8082ab80054b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:37 devstack sudo[105262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-846160af-053c-4e4d-b235-8082ab80054b
Jul 04 00:15:37 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:38 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-846160af-053c-4e4d-b235-8082ab80054b" returned: 0 in 0.683s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:15:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.128s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] Creating offline snapshot d02210f9-a210-4df8-92c8-badcb68bd00f of volume 30f5deff-e313-4e33-ac3a-09a277555164 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:15:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5122ae4-762d-41ec-a336-79f483ab6a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846160af-053c-4e4d-b235-8082ab80054b', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e17bcc-3d18-4619-bb42-0c397c3c0af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:38 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fef110-bda3-4de7-899c-775d57b0ee24]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:38 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume volume-846160af-053c-4e4d-b235-8082ab80054b (846160af-053c-4e4d-b235-8082ab80054b): created successfully
Jul 04 00:15:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e17bcc-3d18-4619-bb42-0c397c3c0af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Flow 'volume_create_manager' (8c2913e5-640f-42c1-be1a-550423f6c8c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:38 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-4688a6b0-9398-4671-abb7-cf0d05b55397 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Created volume successfully.
Jul 04 00:15:38 devstack sudo[105267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164
Jul 04 00:15:38 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Flow 'volume_create_manager' (519d44eb-5ac1-49a8-8aaa-c1363c26436f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d490017b-0998-4eff-abaa-ac63eb199cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d490017b-0998-4eff-abaa-ac63eb199cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c04d2f-a320-419c-9884-a48a2096f373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b004bf0c61473a8564458ce5da11d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:39Z,use_quota=True,user_id='1244b5c8f5e944088239f5028a634b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2d4c6c-61a8-4a5d-8abe-0528587db9f9),volume_type_id=6c2d4c6c-61a8-4a5d-8abe-0528587db9f9)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c4caba-daf4-49c7-8bf6-a384f107dcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22c4caba-daf4-49c7-8bf6-a384f107dcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a70007-2ab2-4af1-8cf9-7e835ed432f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG cinder.image.glance [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Creating Keystone auth plugin from conf {{(pid=86650) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a70007-2ab2-4af1-8cf9-7e835ed432f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '31c04d2f-a320-419c-9884-a48a2096f373', 'volume_name': 'volume-31c04d2f-a320-419c-9884-a48a2096f373', 'volume_size': 1, 'image_id': '15b0175f-ac0a-4687-8bc8-87a5de99020d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15b0175f-ac0a-4687-8bc8-87a5de99020d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '14e0e7d9dc32af8200cf1b72de43dd0c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79b004bf0c61473a8564458ce5da11d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '677ffc8559caaec6fa2cff60446d75762a7877c18c61e52bd33854321117092fcd178b9a4391085c3f663f2db0b8ab59896284accbc04a1758e4f423d8599427', 'id': '15b0175f-ac0a-4687-8bc8-87a5de99020d', 'created_at': datetime.datetime(2026, 7, 3, 22, 15, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 15, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15b0175f-ac0a-4687-8bc8-87a5de99020d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b001549df0>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa10019-2635-4c10-bfaa-bdf8411e6753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa10019-2635-4c10-bfaa-bdf8411e6753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4de7f69-0ecb-4446-913d-15f5f8e5bd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:39 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Volume 31c04d2f-a320-419c-9884-a48a2096f373: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-31c04d2f-a320-419c-9884-a48a2096f373', 'volume_size': 1, 'image_id': '15b0175f-ac0a-4687-8bc8-87a5de99020d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15b0175f-ac0a-4687-8bc8-87a5de99020d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '14e0e7d9dc32af8200cf1b72de43dd0c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79b004bf0c61473a8564458ce5da11d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '677ffc8559caaec6fa2cff60446d75762a7877c18c61e52bd33854321117092fcd178b9a4391085c3f663f2db0b8ab59896284accbc04a1758e4f423d8599427', 'id': '15b0175f-ac0a-4687-8bc8-87a5de99020d', 'created_at': datetime.datetime(2026, 7, 3, 22, 15, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 15, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15b0175f-ac0a-4687-8bc8-87a5de99020d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b001549df0>}
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Trying to clone 31c04d2f-a320-419c-9884-a48a2096f373 from image 15b0175f-ac0a-4687-8bc8-87a5de99020d at location (None, [{'url': 'file:///opt/stack/data/glance/images/15b0175f-ac0a-4687-8bc8-87a5de99020d', 'metadata': {}}]). {{(pid=86650) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 04 00:15:39 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164" returned: 0 in 0.912s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:39 devstack sudo[105272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f 1G
Jul 04 00:15:39 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 04 00:15:39 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Image download 0.00 MB at 0.00 MB/s
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9dd1abc-e827-40b3-89be-94b1167e3d86]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:39 devstack sudo[105274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD
Jul 04 00:15:39 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Flow 'volume_create_manager' (b3da3db0-4483-4beb-99d3-3b82d9bc223d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47423580-2a20-4c9c-86fc-5c95065f2c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47423580-2a20-4c9c-86fc-5c95065f2c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-931704114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80dd2799-46bb-4817-91e5-2e753c308052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eee5923835d44ee49facff3e28132138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:40Z,use_quota=True,user_id='67f366820f8c4578a5ad5b91d91b0dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a636993b-d4a7-4ceb-8131-b67e4abc80b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a636993b-d4a7-4ceb-8131-b67e4abc80b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9924a08b-031c-458f-a33e-47aea0945ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9924a08b-031c-458f-a33e-47aea0945ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80dd2799-46bb-4817-91e5-2e753c308052', 'volume_name': 'volume-80dd2799-46bb-4817-91e5-2e753c308052', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ace6101-fb26-43fb-802e-46f4bf7788e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ace6101-fb26-43fb-802e-46f4bf7788e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c2c285-93e2-48d3-bdeb-648cfedb31f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:40 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume 80dd2799-46bb-4817-91e5-2e753c308052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80dd2799-46bb-4817-91e5-2e753c308052', 'volume_size': 1}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:40 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f 1G" returned: 0 in 0.972s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f5deff-e313-4e33-ac3a-09a277555164 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:40 devstack sudo[105283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f5deff-e313-4e33-ac3a-09a277555164 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f
Jul 04 00:15:40 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:40 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD" returned: 0 in 0.908s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Flow 'volume_create_manager' (73afbfc2-8b7a-46e0-9909-cb10d5b5fc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c3c917-85c6-47d9-9b7d-98fe00aa3fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:40 devstack sudo[105285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD
Jul 04 00:15:40 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c3c917-85c6-47d9-9b7d-98fe00aa3fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-834351542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd615a0-44df-49ed-be46-7823ff73a03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eee5923835d44ee49facff3e28132138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:41Z,use_quota=True,user_id='67f366820f8c4578a5ad5b91d91b0dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643f0df7-26b2-4acd-9962-af7c7193ae38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (643f0df7-26b2-4acd-9962-af7c7193ae38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256c8773-6a32-4739-b48c-3ccb60d2e8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (256c8773-6a32-4739-b48c-3ccb60d2e8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fd615a0-44df-49ed-be46-7823ff73a03f', 'volume_name': 'volume-0fd615a0-44df-49ed-be46-7823ff73a03f', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea874478-16c2-473e-8634-13d25351f182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea874478-16c2-473e-8634-13d25351f182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a4e077-f74f-4334-8d2a-32f56c3f134f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:40 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume 0fd615a0-44df-49ed-be46-7823ff73a03f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fd615a0-44df-49ed-be46-7823ff73a03f', 'volume_size': 1}
Jul 04 00:15:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Flow 'volume_create_manager' (f7e4bb63-baf7-49c2-8449-933016ad48d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b08130-db7d-4a41-80cb-76d8b905fe09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47b08130-db7d-4a41-80cb-76d8b905fe09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1247344126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c26b76-5952-4f23-a555-b6b4460baaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eee5923835d44ee49facff3e28132138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:41Z,use_quota=True,user_id='67f366820f8c4578a5ad5b91d91b0dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8790dc45-7e92-4465-91d6-a424de749329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8790dc45-7e92-4465-91d6-a424de749329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61361803-4733-45e3-a1c9-57cc158e3351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61361803-4733-45e3-a1c9-57cc158e3351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1c26b76-5952-4f23-a555-b6b4460baaeb', 'volume_name': 'volume-e1c26b76-5952-4f23-a555-b6b4460baaeb', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54b22d5-a559-4b8c-b2c9-f083c614148e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54b22d5-a559-4b8c-b2c9-f083c614148e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d00d00d-1dae-427c-b42f-4ce79580af47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:41 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume e1c26b76-5952-4f23-a555-b6b4460baaeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1c26b76-5952-4f23-a555-b6b4460baaeb', 'volume_size': 1}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f5deff-e313-4e33-ac3a-09a277555164 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f" returned: 0 in 0.979s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:41 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f is being set with open permissions: ugo+rw
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:41 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:41 devstack sudo[105290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f
Jul 04 00:15:41 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Flow 'volume_create_manager' (ca89f910-d395-4cc4-bee6-2bb097e94ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a603b5a-da2d-466c-971e-5de6ecdfc6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:41 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a603b5a-da2d-466c-971e-5de6ecdfc6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-766783393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e23f69-50d8-42f0-bc69-c0ffe6f22cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eee5923835d44ee49facff3e28132138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:42Z,use_quota=True,user_id='67f366820f8c4578a5ad5b91d91b0dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d1623c-e9fe-4e63-ab28-53cc35420d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d1623c-e9fe-4e63-ab28-53cc35420d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c98f9d6-8353-4976-9c75-4be3f6ce6916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c98f9d6-8353-4976-9c75-4be3f6ce6916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33e23f69-50d8-42f0-bc69-c0ffe6f22cc2', 'volume_name': 'volume-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42967f5-4dd3-4904-835f-5d3361b66e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42967f5-4dd3-4904-835f-5d3361b66e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8acee0f-a756-4b9b-8c45-9aa03f30af74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:41 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume 33e23f69-50d8-42f0-bc69-c0ffe6f22cc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2', 'volume_size': 1}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD" returned: 1 in 1.260s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:15:41 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Temporary image 15b0175f-ac0a-4687-8bc8-87a5de99020d is fetched for user 1244b5c8f5e944088239f5028a634b97. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[de68dbd0-2ac8-42cc-9a5d-0a70c392301d]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:42 devstack sudo[105295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD
Jul 04 00:15:42 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Flow 'volume_create_manager' (e2f56141-118c-4112-b94d-1c2ece7c1670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dbba53d-b2e8-491d-84b9-095b893dfc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dbba53d-b2e8-491d-84b9-095b893dfc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1041853888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e33351-d28b-45b6-a9f5-13ef2617bbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eee5923835d44ee49facff3e28132138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:42Z,use_quota=True,user_id='67f366820f8c4578a5ad5b91d91b0dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ee894e-bb4c-48dd-a21d-b02500c6d648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ee894e-bb4c-48dd-a21d-b02500c6d648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d710a4ec-c3ae-4685-815d-5054e1e8fe6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d710a4ec-c3ae-4685-815d-5054e1e8fe6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7e33351-d28b-45b6-a9f5-13ef2617bbcc', 'volume_name': 'volume-f7e33351-d28b-45b6-a9f5-13ef2617bbcc', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd202ee8-ac57-4064-b576-d95f2927056c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd202ee8-ac57-4064-b576-d95f2927056c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b44f6d0-8433-4197-ac2d-4d54875dd500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:42 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume f7e33351-d28b-45b6-a9f5-13ef2617bbcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7e33351-d28b-45b6-a9f5-13ef2617bbcc', 'volume_size': 1}
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:42 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f" returned: 0 in 0.983s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:42 devstack sudo[105298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.info
Jul 04 00:15:42 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:42 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD" returned: 0 in 0.860s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:42 devstack sudo[105302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD
Jul 04 00:15:43 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:43 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.info" returned: 0 in 0.716s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:43 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.info is being set with open permissions: ugo+rw
Jul 04 00:15:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:43 devstack sudo[105305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.info
Jul 04 00:15:43 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:43 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD" returned: 1 in 0.838s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:15:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:43 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.info" returned: 0 in 0.693s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.372s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.570s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-931704114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80dd2799-46bb-4817-91e5-2e753c308052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eee5923835d44ee49facff3e28132138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:40Z,use_quota=True,user_id='67f366820f8c4578a5ad5b91d91b0dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:15:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Creating volume 80dd2799-46bb-4817-91e5-2e753c308052 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:15:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:15:44 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:15:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80dd2799-46bb-4817-91e5-2e753c308052 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:44 devstack sudo[105311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80dd2799-46bb-4817-91e5-2e753c308052 1073741824
Jul 04 00:15:44 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-4c66c1f8-b56b-40d7-ab94-d415e8087fb3 tempest-VolumeDependencyTests-193571950 None] Create snapshot completed successfully
Jul 04 00:15:44 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80dd2799-46bb-4817-91e5-2e753c308052 1073741824" returned: 0 in 0.824s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80dd2799-46bb-4817-91e5-2e753c308052 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:44 devstack sudo[105318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80dd2799-46bb-4817-91e5-2e753c308052
Jul 04 00:15:44 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:45 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80dd2799-46bb-4817-91e5-2e753c308052" returned: 0 in 0.750s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.749s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-834351542',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fd615a0-44df-49ed-be46-7823ff73a03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eee5923835d44ee49facff3e28132138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:41Z,use_quota=True,user_id='67f366820f8c4578a5ad5b91d91b0dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Creating volume 0fd615a0-44df-49ed-be46-7823ff73a03f {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:15:45 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fd615a0-44df-49ed-be46-7823ff73a03f 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:45 devstack sudo[105321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fd615a0-44df-49ed-be46-7823ff73a03f 1073741824
Jul 04 00:15:45 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7c2c285-93e2-48d3-bdeb-648cfedb31f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80dd2799-46bb-4817-91e5-2e753c308052', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77932259-5e4e-44f7-a5e5-b72bf769bba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:45 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume volume-80dd2799-46bb-4817-91e5-2e753c308052 (80dd2799-46bb-4817-91e5-2e753c308052): created successfully
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77932259-5e4e-44f7-a5e5-b72bf769bba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Flow 'volume_create_manager' (b3da3db0-4483-4beb-99d3-3b82d9bc223d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Flow 'volume_create_manager' (43738eaf-8172-47ec-a709-7996b3de14cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c2fae8-a8e4-48eb-b935-6145b45f3db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:45 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e8c4a5b9-ad27-42e9-8bc1-d21daa55d9f8 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Created volume successfully.
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Flow 'volume_create_manager' (b86d777c-db1b-402b-9345-46a03a50eec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08b448c-c356-49fd-86d5-90a7304c0177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c2fae8-a8e4-48eb-b935-6145b45f3db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-246752883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cacd5b5-af43-43a0-95f2-5021ca025bf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9e1897dac4f599e4ec256965b7ebf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d02210f9-a210-4df8-92c8-badcb68bd00f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:46Z,use_quota=True,user_id='022897e1a1a74bdfa4fb6e331fb9766b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca538063-02ab-4645-9e90-1ce08642e4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca538063-02ab-4645-9e90-1ce08642e4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb39380e-3890-4fe5-a306-5e78fd5c615f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb39380e-3890-4fe5-a306-5e78fd5c615f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3cacd5b5-af43-43a0-95f2-5021ca025bf4', 'volume_name': 'volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4', 'volume_size': 1, 'snapshot_id': 'd02210f9-a210-4df8-92c8-badcb68bd00f'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60dcfdf9-04b7-4e3a-bcb5-4fea723b2de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60dcfdf9-04b7-4e3a-bcb5-4fea723b2de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254a03da-4572-418a-82ae-ececc2dba5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:45 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Volume 3cacd5b5-af43-43a0-95f2-5021ca025bf4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4', 'volume_size': 1, 'snapshot_id': 'd02210f9-a210-4df8-92c8-badcb68bd00f'}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f08b448c-c356-49fd-86d5-90a7304c0177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-415472800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc90b28-3bb1-4251-a390-97728881202c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40688e121314c2a86fc43f538f502ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:46Z,use_quota=True,user_id='83c7c0dd8f4b41418e96753a9845d331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb26b28-0b0e-4524-8afd-5794a887d5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beb26b28-0b0e-4524-8afd-5794a887d5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba28705b-a958-49fd-8980-563e99913ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba28705b-a958-49fd-8980-563e99913ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fc90b28-3bb1-4251-a390-97728881202c', 'volume_name': 'volume-0fc90b28-3bb1-4251-a390-97728881202c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27ada47-77ba-454c-a958-459cc21f8244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27ada47-77ba-454c-a958-459cc21f8244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b26fea-0910-4646-bd2e-71d6aac6380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:45 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Volume 0fc90b28-3bb1-4251-a390-97728881202c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fc90b28-3bb1-4251-a390-97728881202c', 'volume_size': 1}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:46 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fd615a0-44df-49ed-be46-7823ff73a03f 1073741824" returned: 0 in 0.881s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fd615a0-44df-49ed-be46-7823ff73a03f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:46 devstack sudo[105326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fd615a0-44df-49ed-be46-7823ff73a03f
Jul 04 00:15:46 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:47 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fd615a0-44df-49ed-be46-7823ff73a03f" returned: 0 in 0.615s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.748s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1247344126',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c26b76-5952-4f23-a555-b6b4460baaeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eee5923835d44ee49facff3e28132138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:41Z,use_quota=True,user_id='67f366820f8c4578a5ad5b91d91b0dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Creating volume e1c26b76-5952-4f23-a555-b6b4460baaeb {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:15:47 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e1c26b76-5952-4f23-a555-b6b4460baaeb 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61a4e077-f74f-4334-8d2a-32f56c3f134f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fd615a0-44df-49ed-be46-7823ff73a03f', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:47 devstack sudo[105329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e1c26b76-5952-4f23-a555-b6b4460baaeb 1073741824
Jul 04 00:15:47 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb83617-a73e-4c4d-92af-ed299fca1e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:47 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume volume-0fd615a0-44df-49ed-be46-7823ff73a03f (0fd615a0-44df-49ed-be46-7823ff73a03f): created successfully
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdb83617-a73e-4c4d-92af-ed299fca1e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Flow 'volume_create_manager' (73afbfc2-8b7a-46e0-9909-cb10d5b5fc50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:47 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7e9ca732-2e6b-4a5f-93ab-40fb9c15e0ff tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Created volume successfully.
Jul 04 00:15:47 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e1c26b76-5952-4f23-a555-b6b4460baaeb 1073741824" returned: 0 in 0.800s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e1c26b76-5952-4f23-a555-b6b4460baaeb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:48 devstack sudo[105335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e1c26b76-5952-4f23-a555-b6b4460baaeb
Jul 04 00:15:48 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:48 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e1c26b76-5952-4f23-a555-b6b4460baaeb" returned: 0 in 0.667s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] <== create_volume: return (1509ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.821s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-766783393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33e23f69-50d8-42f0-bc69-c0ffe6f22cc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eee5923835d44ee49facff3e28132138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:42Z,use_quota=True,user_id='67f366820f8c4578a5ad5b91d91b0dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Creating volume 33e23f69-50d8-42f0-bc69-c0ffe6f22cc2 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:15:48 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:48 devstack sudo[105338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2 1073741824
Jul 04 00:15:48 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d00d00d-1dae-427c-b42f-4ce79580af47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c26b76-5952-4f23-a555-b6b4460baaeb', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2979c9cb-563a-44b6-ad97-43942c3f8bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:48 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume volume-e1c26b76-5952-4f23-a555-b6b4460baaeb (e1c26b76-5952-4f23-a555-b6b4460baaeb): created successfully
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2979c9cb-563a-44b6-ad97-43942c3f8bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Flow 'volume_create_manager' (f7e4bb63-baf7-49c2-8449-933016ad48d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:48 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-365c6063-0187-4a7c-b429-639569c17250 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Created volume successfully.
Jul 04 00:15:49 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2 1073741824" returned: 0 in 0.779s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:49 devstack sudo[105343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2
Jul 04 00:15:49 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:50 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2" returned: 0 in 0.652s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.899s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1041853888',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e33351-d28b-45b6-a9f5-13ef2617bbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eee5923835d44ee49facff3e28132138',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:42Z,use_quota=True,user_id='67f366820f8c4578a5ad5b91d91b0dc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Creating volume f7e33351-d28b-45b6-a9f5-13ef2617bbcc {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:15:50 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f7e33351-d28b-45b6-a9f5-13ef2617bbcc 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8acee0f-a756-4b9b-8c45-9aa03f30af74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa57aea8-e974-4711-929d-36ed5c918622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:50 devstack sudo[105346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f7e33351-d28b-45b6-a9f5-13ef2617bbcc 1073741824
Jul 04 00:15:50 devstack sudo[105346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:50 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume volume-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2 (33e23f69-50d8-42f0-bc69-c0ffe6f22cc2): created successfully
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa57aea8-e974-4711-929d-36ed5c918622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Flow 'volume_create_manager' (ca89f910-d395-4cc4-bee6-2bb097e94ed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:50 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-0dc02b77-4a7a-4587-8382-3189d2acbf4b tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Created volume successfully.
Jul 04 00:15:51 devstack sudo[105346]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f7e33351-d28b-45b6-a9f5-13ef2617bbcc 1073741824" returned: 0 in 0.879s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f7e33351-d28b-45b6-a9f5-13ef2617bbcc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:51 devstack sudo[105351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f7e33351-d28b-45b6-a9f5-13ef2617bbcc
Jul 04 00:15:51 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:51 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f7e33351-d28b-45b6-a9f5-13ef2617bbcc" returned: 0 in 0.625s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.018s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31c04d2f-a320-419c-9884-a48a2096f373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b004bf0c61473a8564458ce5da11d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:39Z,use_quota=True,user_id='1244b5c8f5e944088239f5028a634b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6c2d4c6c-61a8-4a5d-8abe-0528587db9f9),volume_type_id=6c2d4c6c-61a8-4a5d-8abe-0528587db9f9)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Creating volume 31c04d2f-a320-419c-9884-a48a2096f373 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:15:51 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:51 devstack sudo[105354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373 1073741824
Jul 04 00:15:51 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b44f6d0-8433-4197-ac2d-4d54875dd500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7e33351-d28b-45b6-a9f5-13ef2617bbcc', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0288798b-9ef6-4af0-8646-b963fc050397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:51 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Volume volume-f7e33351-d28b-45b6-a9f5-13ef2617bbcc (f7e33351-d28b-45b6-a9f5-13ef2617bbcc): created successfully
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0288798b-9ef6-4af0-8646-b963fc050397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Flow 'volume_create_manager' (e2f56141-118c-4112-b94d-1c2ece7c1670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:51 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-42133f34-c902-4cc4-9d5b-112cd785bd0f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Created volume successfully.
Jul 04 00:15:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "cinder-f7e33351-d28b-45b6-a9f5-13ef2617bbcc-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-f7e33351-d28b-45b6-a9f5-13ef2617bbcc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "cinder-quobyte-f7e33351-d28b-45b6-a9f5-13ef2617bbcc" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-quobyte-f7e33351-d28b-45b6-a9f5-13ef2617bbcc" acquired by "delete_volume" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:52 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[944c895b-e3d7-4072-9a60-189fee43245f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f7e33351-d28b-45b6-a9f5-13ef2617bbcc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:52 devstack sudo[105356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f7e33351-d28b-45b6-a9f5-13ef2617bbcc
Jul 04 00:15:52 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:52 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373 1073741824" returned: 0 in 0.856s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:52 devstack sudo[105361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373
Jul 04 00:15:52 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:53 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f7e33351-d28b-45b6-a9f5-13ef2617bbcc" returned: 0 in 0.843s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f7e33351-d28b-45b6-a9f5-13ef2617bbcc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:53 devstack sudo[105366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f7e33351-d28b-45b6-a9f5-13ef2617bbcc
Jul 04 00:15:53 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:53 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373" returned: 0 in 0.634s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.372s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-415472800',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc90b28-3bb1-4251-a390-97728881202c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40688e121314c2a86fc43f538f502ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:15:46Z,use_quota=True,user_id='83c7c0dd8f4b41418e96753a9845d331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Creating volume 0fc90b28-3bb1-4251-a390-97728881202c {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:15:53 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fc90b28-3bb1-4251-a390-97728881202c 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:53 devstack sudo[105369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fc90b28-3bb1-4251-a390-97728881202c 1073741824
Jul 04 00:15:53 devstack sudo[105369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Attempting download of 15b0175f-ac0a-4687-8bc8-87a5de99020d ((None, [{'url': 'file:///opt/stack/data/glance/images/15b0175f-ac0a-4687-8bc8-87a5de99020d', 'metadata': {}}])) to volume 31c04d2f-a320-419c-9884-a48a2096f373. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e30bfb-b6d4-4c79-be18-4f583f2d91d2]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15b0175f-ac0a-4687-8bc8-87a5de99020d_wyhvotem {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:53 devstack sudo[105371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15b0175f-ac0a-4687-8bc8-87a5de99020d_wyhvotem
Jul 04 00:15:53 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:53 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-f7e33351-d28b-45b6-a9f5-13ef2617bbcc" returned: 0 in 0.694s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-quobyte-f7e33351-d28b-45b6-a9f5-13ef2617bbcc" released by "delete_volume" :: held 1.580s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Created reservations ['18e95dff-67b4-416d-a0eb-12999536b73c', 'b34e34d9-f1b3-404d-b15c-d41928d6fb4b', 'e95e588e-4126-46b0-ad23-483ca73030fc', 'f350f19c-a101-4209-9af4-dd4a70489f55'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:53 devstack sudo[105375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:15:53 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:54 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_15b0175f-ac0a-4687-8bc8-87a5de99020d_wyhvotem" returned: 0 in 0.851s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15b0175f-ac0a-4687-8bc8-87a5de99020d_wyhvotem {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:54 devstack sudo[105369]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fc90b28-3bb1-4251-a390-97728881202c 1073741824" returned: 0 in 0.984s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fc90b28-3bb1-4251-a390-97728881202c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:54 devstack sudo[105384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fc90b28-3bb1-4251-a390-97728881202c
Jul 04 00:15:54 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "cinder-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:54 devstack sudo[105383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15b0175f-ac0a-4687-8bc8-87a5de99020d_wyhvotem
Jul 04 00:15:54 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "cinder-quobyte-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-quobyte-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:54 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee2c140-4fc1-476e-8fa8-c9a3cbff8b0e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:54 devstack sudo[105387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2
Jul 04 00:15:54 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:54 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.845s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:54 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:15:54 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Deleted volume successfully.
Jul 04 00:15:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-543970cc-6364-46f0-beba-a8dbfb54c721 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-f7e33351-d28b-45b6-a9f5-13ef2617bbcc-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:55 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15b0175f-ac0a-4687-8bc8-87a5de99020d_wyhvotem" returned: 1 in 0.846s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_15b0175f-ac0a-4687-8bc8-87a5de99020d_wyhvotem' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e051db-86eb-47d9-a3d4-0de7eb083455]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:55 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fc90b28-3bb1-4251-a390-97728881202c" returned: 0 in 0.819s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.254s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Acquiring lock "cinder-quobyte-d02210f9-a210-4df8-92c8-badcb68bd00f-3cacd5b5-af43-43a0-95f2-5021ca025bf4" by "_create_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73b26fea-0910-4646-bd2e-71d6aac6380b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fc90b28-3bb1-4251-a390-97728881202c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6558569-efa5-4ec7-8829-bbf8dfaf5294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Lock "cinder-quobyte-d02210f9-a210-4df8-92c8-badcb68bd00f-3cacd5b5-af43-43a0-95f2-5021ca025bf4" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Creating volume 3cacd5b5-af43-43a0-95f2-5021ca025bf4 from snapshot d02210f9-a210-4df8-92c8-badcb68bd00f {{(pid=86650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Acquiring lock "cinder-quobyte-3cacd5b5-af43-43a0-95f2-5021ca025bf4" by "_copy_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:55 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Volume volume-0fc90b28-3bb1-4251-a390-97728881202c (0fc90b28-3bb1-4251-a390-97728881202c): created successfully
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6558569-efa5-4ec7-8829-bbf8dfaf5294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:15:55 devstack sudo[105393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD
Jul 04 00:15:55 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Flow 'volume_create_manager' (b86d777c-db1b-402b-9345-46a03a50eec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Lock "cinder-quobyte-3cacd5b5-af43-43a0-95f2-5021ca025bf4" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] snapshot: d02210f9-a210-4df8-92c8-badcb68bd00f, volume: 3cacd5b5-af43-43a0-95f2-5021ca025bf4,  {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:15:55 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-d426683b-1e5f-4138-8933-24b3564f1a37 tempest-ProjectReaderTests-681454012 None] Created volume successfully.
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b7e287-11c2-416c-8926-a39a04f1bf71]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:55 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2" returned: 0 in 0.908s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:55 devstack sudo[105398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f
Jul 04 00:15:55 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:55 devstack sudo[105400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2
Jul 04 00:15:55 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Acquiring lock "cinder-0fc90b28-3bb1-4251-a390-97728881202c-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Lock "cinder-0fc90b28-3bb1-4251-a390-97728881202c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Acquiring lock "cinder-quobyte-0fc90b28-3bb1-4251-a390-97728881202c" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Lock "cinder-quobyte-0fc90b28-3bb1-4251-a390-97728881202c" acquired by "delete_volume" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4de20b2-defe-4cbf-9644-66617433921c]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fc90b28-3bb1-4251-a390-97728881202c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:56 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD" returned: 0 in 0.915s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:56 devstack sudo[105404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fc90b28-3bb1-4251-a390-97728881202c
Jul 04 00:15:56 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:56 devstack sudo[105405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD
Jul 04 00:15:56 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:56 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2" returned: 0 in 0.850s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-quobyte-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2" released by "delete_volume" :: held 1.843s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:56 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f" returned: 0 in 1.037s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30f5deff-e313-4e33-ac3a-09a277555164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164 {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Creating direct copy from snapshot {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b22f1d5-1844-4b16-9f0d-d4ef0b579b34]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Created reservations ['c44f7296-94a4-4faa-b9ed-63eae12d7eb4', 'f60da92e-a528-4587-8a2e-66796e642240', '026727a8-a226-4512-855f-bc2418729a71', '57b93641-611c-4d5f-a6ef-469776b0dda8'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:15:56 devstack sudo[105443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164
Jul 04 00:15:56 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:56 devstack sudo[105449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:15:56 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "cinder-e1c26b76-5952-4f23-a555-b6b4460baaeb-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-e1c26b76-5952-4f23-a555-b6b4460baaeb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "cinder-quobyte-e1c26b76-5952-4f23-a555-b6b4460baaeb" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-quobyte-e1c26b76-5952-4f23-a555-b6b4460baaeb" acquired by "delete_volume" :: waited 0.050s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43a48ed-c6b0-400b-be34-b3a75f4feddd]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:15:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e1c26b76-5952-4f23-a555-b6b4460baaeb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:57 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD" returned: 1 in 1.053s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:15:57 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] 15b0175f-ac0a-4687-8bc8-87a5de99020d was raw, converting to raw {{(pid=86650) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 04 00:15:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:57 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fc90b28-3bb1-4251-a390-97728881202c" returned: 0 in 1.187s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fc90b28-3bb1-4251-a390-97728881202c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:57 devstack sudo[105457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e1c26b76-5952-4f23-a555-b6b4460baaeb
Jul 04 00:15:57 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:57 devstack sudo[105458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373
Jul 04 00:15:57 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:57 devstack sudo[105459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fc90b28-3bb1-4251-a390-97728881202c
Jul 04 00:15:57 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:57 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164" returned: 0 in 1.155s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:57 devstack cinder-volume[86650]: DEBUG cinder.utils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Path /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4 not found in is_blk_device check {{(pid=86650) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:15:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:57 devstack sudo[105468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4
Jul 04 00:15:57 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:57 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:57 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.387s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:15:58 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Deleted volume successfully.
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e1c26b76-5952-4f23-a555-b6b4460baaeb" returned: 0 in 1.052s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e1c26b76-5952-4f23-a555-b6b4460baaeb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b7c25b1f-9dfd-4d2f-9832-6c9ee050c518 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-33e23f69-50d8-42f0-bc69-c0ffe6f22cc2-delete_volume" released by "delete_volume" :: held 3.656s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:58 devstack sudo[105481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e1c26b76-5952-4f23-a555-b6b4460baaeb
Jul 04 00:15:58 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:58 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fc90b28-3bb1-4251-a390-97728881202c" returned: 0 in 1.060s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Lock "cinder-quobyte-0fc90b28-3bb1-4251-a390-97728881202c" released by "delete_volume" :: held 2.311s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Created reservations ['c3549d90-8925-4d66-afa5-5ba065f98b54', 'a97dcdda-52b2-4c9c-8f7c-aebe07130c0c', '1ca57eb4-08ba-4a4c-bea4-1f486458a511', '8a4def17-f126-4e03-bbab-4b80356bf251'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:58 devstack sudo[105489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:15:58 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:58 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373" returned: 0 in 1.381s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_15b0175f-ac0a-4687-8bc8-87a5de99020d_avatd95ddevstack@QuobyteHD, size 0.00 MB, duration 1.38 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373 {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:15:58 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Converted 0.00 MB image at 0.00 MB/s
Jul 04 00:15:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:15:58 devstack sudo[105491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373 1G
Jul 04 00:15:58 devstack sudo[105491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:15:59 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root
Jul 04 00:15:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e1c26b76-5952-4f23-a555-b6b4460baaeb" returned: 0 in 1.457s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:15:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-quobyte-e1c26b76-5952-4f23-a555-b6b4460baaeb" released by "delete_volume" :: held 2.615s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:15:59 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Created reservations ['a12250fa-27a0-4aad-aa29-4670c476b65d', '3571eb97-937b-4e58-9ac5-a6dda1c9c767', 'e0c48a5a-1fb0-405c-8586-e7d876d8f7f3', '5e2ad0f7-1226-4524-a94f-e6f6767379ad'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:15:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:15:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:15:59 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:00 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.712s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:00 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:00 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Deleted volume successfully.
Jul 04 00:16:00 devstack sudo[105503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:00 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:00 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c4cb2e24-5512-45d2-a953-a277f234ccbe tempest-ProjectReaderTests-681454012 None] Lock "cinder-0fc90b28-3bb1-4251-a390-97728881202c-delete_volume" released by "delete_volume" :: held 4.374s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:00 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "cinder-0fd615a0-44df-49ed-be46-7823ff73a03f-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:00 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-0fd615a0-44df-49ed-be46-7823ff73a03f-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:00 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "cinder-quobyte-0fd615a0-44df-49ed-be46-7823ff73a03f" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:00 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-quobyte-0fd615a0-44df-49ed-be46-7823ff73a03f" acquired by "delete_volume" :: waited 0.045s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:00 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f092349b-c96f-404d-abd7-449c75f8099f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fd615a0-44df-49ed-be46-7823ff73a03f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:00 devstack sudo[105491]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373 1G" returned: 0 in 2.518s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c46a79-a83e-4621-94e3-b99370a4ae49]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:01 devstack sudo[105508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fd615a0-44df-49ed-be46-7823ff73a03f
Jul 04 00:16:01 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Flow 'volume_create_manager' (68a68a7c-d030-4bec-a06b-11919afe6f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f062c018-cfe4-4ea2-9e98-872c9ef6e0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:01 devstack sudo[105509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373
Jul 04 00:16:01 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f062c018-cfe4-4ea2-9e98-872c9ef6e0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486320338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09ae6ac-5c87-40e0-9d32-7b1e667ea29f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40688e121314c2a86fc43f538f502ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:01Z,use_quota=True,user_id='83c7c0dd8f4b41418e96753a9845d331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca4823d-adc6-43fc-83b4-cb738a9fc6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ca4823d-adc6-43fc-83b4-cb738a9fc6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c8f17c-062a-4f59-8a2e-2b5c03226abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c8f17c-062a-4f59-8a2e-2b5c03226abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd09ae6ac-5c87-40e0-9d32-7b1e667ea29f', 'volume_name': 'volume-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ba0a04-915e-4e35-9fc8-a4dc4d347af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98ba0a04-915e-4e35-9fc8-a4dc4d347af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f77789-35a2-4b8f-9a7e-5b7710c2f274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:01 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Volume d09ae6ac-5c87-40e0-9d32-7b1e667ea29f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f', 'volume_size': 1}
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:01 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.745s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:01 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Deleted volume successfully.
Jul 04 00:16:01 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-593f8977-167b-40ad-ae21-73caae6aff07 tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-e1c26b76-5952-4f23-a555-b6b4460baaeb-delete_volume" released by "delete_volume" :: held 5.028s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:02 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fd615a0-44df-49ed-be46-7823ff73a03f" returned: 0 in 1.635s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fd615a0-44df-49ed-be46-7823ff73a03f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:02 devstack sudo[105516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fd615a0-44df-49ed-be46-7823ff73a03f
Jul 04 00:16:02 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:03 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373" returned: 0 in 2.068s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:03 devstack sudo[105520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373
Jul 04 00:16:03 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:04 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0fd615a0-44df-49ed-be46-7823ff73a03f" returned: 0 in 1.626s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-quobyte-0fd615a0-44df-49ed-be46-7823ff73a03f" released by "delete_volume" :: held 3.367s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Created reservations ['d9caaf43-a90a-43ec-9934-b937ad72c886', 'a7a33c27-5bf2-467f-9412-1fc7fe0d27e9', '470757af-44b5-45b4-bb54-1b083519e3d1', '98ca8767-eadd-41e9-a95e-88de25269467'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:04 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4" returned: 0 in 6.828s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bf91c5-de05-4fca-b653-575ef09c9756]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:04 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373" returned: 1 in 1.292s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Downloaded image 15b0175f-ac0a-4687-8bc8-87a5de99020d ((None, [{'url': 'file:///opt/stack/data/glance/images/15b0175f-ac0a-4687-8bc8-87a5de99020d', 'metadata': {}}])) to volume 31c04d2f-a320-419c-9884-a48a2096f373 successfully. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Temporary image 15b0175f-ac0a-4687-8bc8-87a5de99020d for user 1244b5c8f5e944088239f5028a634b97 is deleted. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Marking volume 31c04d2f-a320-419c-9884-a48a2096f373 as bootable. {{(pid=86650) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 04 00:16:04 devstack sudo[105527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:04 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Copying metadata from image 15b0175f-ac0a-4687-8bc8-87a5de99020d to 31c04d2f-a320-419c-9884-a48a2096f373. {{(pid=86650) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Creating volume glance metadata for volume 31c04d2f-a320-419c-9884-a48a2096f373 backed by image 15b0175f-ac0a-4687-8bc8-87a5de99020d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '15b0175f-ac0a-4687-8bc8-87a5de99020d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '14e0e7d9dc32af8200cf1b72de43dd0c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86650) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4de7f69-0ecb-4446-913d-15f5f8e5bd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31c04d2f-a320-419c-9884-a48a2096f373', 'volume_size': 1, 'image_id': '15b0175f-ac0a-4687-8bc8-87a5de99020d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/15b0175f-ac0a-4687-8bc8-87a5de99020d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '14e0e7d9dc32af8200cf1b72de43dd0c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '79b004bf0c61473a8564458ce5da11d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '677ffc8559caaec6fa2cff60446d75762a7877c18c61e52bd33854321117092fcd178b9a4391085c3f663f2db0b8ab59896284accbc04a1758e4f423d8599427', 'id': '15b0175f-ac0a-4687-8bc8-87a5de99020d', 'created_at': datetime.datetime(2026, 7, 3, 22, 15, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 15, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/15b0175f-ac0a-4687-8bc8-87a5de99020d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b001549df0>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257e59fb-e1f4-4371-b03c-241022a117dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:04 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Volume volume-31c04d2f-a320-419c-9884-a48a2096f373 (31c04d2f-a320-419c-9884-a48a2096f373): created successfully
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257e59fb-e1f4-4371-b03c-241022a117dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Flow 'volume_create_manager' (519d44eb-5ac1-49a8-8aaa-c1363c26436f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:04 devstack sudo[105528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164
Jul 04 00:16:04 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-47628b71-d251-4f8e-81b6-e66fdd1c6946 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Created volume successfully.
Jul 04 00:16:04 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:05 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.729s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:05 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Deleted volume successfully.
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e4c6bc92-f3cf-4dd4-85c0-f22a4476b78f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-0fd615a0-44df-49ed-be46-7823ff73a03f-delete_volume" released by "delete_volume" :: held 4.543s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:05 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164" returned: 0 in 0.953s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Image conversion details: src /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164, size 1024.00 MB, duration 6.83 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4 {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:16:05 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Converted 1024.00 MB image at 149.93 MB/s
Jul 04 00:16:05 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4 is being set with open permissions: ugo+rw
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "cinder-80dd2799-46bb-4817-91e5-2e753c308052-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:05 devstack sudo[105535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4
Jul 04 00:16:05 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-80dd2799-46bb-4817-91e5-2e753c308052-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "cinder-quobyte-80dd2799-46bb-4817-91e5-2e753c308052" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Acquiring lock "cinder-31c04d2f-a320-419c-9884-a48a2096f373-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-quobyte-80dd2799-46bb-4817-91e5-2e753c308052" acquired by "delete_volume" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Lock "cinder-31c04d2f-a320-419c-9884-a48a2096f373-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[0617d30b-e8a4-4004-920b-b903b6bbd4ad]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80dd2799-46bb-4817-91e5-2e753c308052 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Acquiring lock "cinder-quobyte-31c04d2f-a320-419c-9884-a48a2096f373" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Lock "cinder-quobyte-31c04d2f-a320-419c-9884-a48a2096f373" acquired by "delete_volume" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[72825de2-278d-4a42-9e43-e227ddcf8568]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:05 devstack sudo[105537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80dd2799-46bb-4817-91e5-2e753c308052
Jul 04 00:16:05 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:05 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373
Jul 04 00:16:05 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:06 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4" returned: 0 in 0.715s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Lock "cinder-quobyte-3cacd5b5-af43-43a0-95f2-5021ca025bf4" released by "_copy_volume_from_snapshot" :: held 10.860s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Lock "cinder-quobyte-d02210f9-a210-4df8-92c8-badcb68bd00f-3cacd5b5-af43-43a0-95f2-5021ca025bf4" released by "_create_volume_from_snapshot" :: held 10.925s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.959s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.457s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1486320338',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d09ae6ac-5c87-40e0-9d32-7b1e667ea29f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40688e121314c2a86fc43f538f502ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:01Z,use_quota=True,user_id='83c7c0dd8f4b41418e96753a9845d331',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Creating volume d09ae6ac-5c87-40e0-9d32-7b1e667ea29f {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:16:06 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:06 devstack sudo[105542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f 1073741824
Jul 04 00:16:06 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254a03da-4572-418a-82ae-ececc2dba5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4', 'volume_size': 1, 'snapshot_id': 'd02210f9-a210-4df8-92c8-badcb68bd00f'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2520417-f337-4aec-92fe-c5daa6e807ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:06 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Volume volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4 (3cacd5b5-af43-43a0-95f2-5021ca025bf4): created successfully
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2520417-f337-4aec-92fe-c5daa6e807ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Flow 'volume_create_manager' (43738eaf-8172-47ec-a709-7996b3de14cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:06 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-4059b001-89f3-42db-a44a-85d95a430cae tempest-VolumeDependencyTests-193571950 None] Created volume successfully.
Jul 04 00:16:06 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80dd2799-46bb-4817-91e5-2e753c308052" returned: 0 in 0.792s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80dd2799-46bb-4817-91e5-2e753c308052 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:06 devstack sudo[105549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80dd2799-46bb-4817-91e5-2e753c308052
Jul 04 00:16:06 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:06 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373" returned: 0 in 0.776s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:06 devstack sudo[105551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373
Jul 04 00:16:06 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Acquiring lock "cinder-d02210f9-a210-4df8-92c8-badcb68bd00f-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Lock "cinder-d02210f9-a210-4df8-92c8-badcb68bd00f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Acquiring lock "cinder-quobyte-30f5deff-e313-4e33-ac3a-09a277555164" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Lock "cinder-quobyte-30f5deff-e313-4e33-ac3a-09a277555164" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Acquiring lock "cinder-quobyte-d02210f9-a210-4df8-92c8-badcb68bd00f" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Lock "cinder-quobyte-d02210f9-a210-4df8-92c8-badcb68bd00f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Deleting offline snapshot d02210f9-a210-4df8-92c8-badcb68bd00f of volume 30f5deff-e313-4e33-ac3a-09a277555164 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] snapshot_file for this snap is: volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e68f1c-c26d-4deb-b2ec-a279a8dbaefc]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:07 devstack sudo[105556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f
Jul 04 00:16:07 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:07 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f 1073741824" returned: 0 in 0.995s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:07 devstack sudo[105559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f
Jul 04 00:16:07 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:07 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-80dd2799-46bb-4817-91e5-2e753c308052" returned: 0 in 0.876s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-quobyte-80dd2799-46bb-4817-91e5-2e753c308052" released by "delete_volume" :: held 1.743s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Created reservations ['630acc8c-6ad3-47cb-a93b-e4ad86a149ca', '94c2b671-d3dd-40e9-80ea-75974a47f143', 'cb4657df-f29e-4cd0-b484-dbf4e780e1ba', '10de7791-2302-41b2-b5b6-06dd4bcb6087'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:07 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373" returned: 1 in 0.906s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:07 devstack sudo[105564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373
Jul 04 00:16:07 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:07 devstack sudo[105566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:07 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "cinder-846160af-053c-4e4d-b235-8082ab80054b-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-846160af-053c-4e4d-b235-8082ab80054b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "cinder-quobyte-846160af-053c-4e4d-b235-8082ab80054b" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-quobyte-846160af-053c-4e4d-b235-8082ab80054b" acquired by "delete_volume" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e3ba64-50ff-4af5-8031-cc3fa8227925]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-846160af-053c-4e4d-b235-8082ab80054b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:07 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:07 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f" returned: 0 in 0.791s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f" returned: 0 in 1.054s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30f5deff-e313-4e33-ac3a-09a277555164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04f77789-35a2-4b8f-9a7e-5b7710c2f274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215e63fb-2ff3-42f7-a451-120dcb5eb526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b8f89e-9e6e-4179-836f-bbce9c39e304]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:08 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Volume volume-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f (d09ae6ac-5c87-40e0-9d32-7b1e667ea29f): created successfully
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215e63fb-2ff3-42f7-a451-120dcb5eb526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Flow 'volume_create_manager' (68a68a7c-d030-4bec-a06b-11919afe6f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:08 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f5acefc3-6151-4290-bd20-e76648990562 tempest-ProjectReaderTests-681454012 None] Created volume successfully.
Jul 04 00:16:08 devstack sudo[105573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-846160af-053c-4e4d-b235-8082ab80054b
Jul 04 00:16:08 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:08 devstack sudo[105574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164
Jul 04 00:16:08 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:08 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-31c04d2f-a320-419c-9884-a48a2096f373" returned: 0 in 0.935s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:08 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Lock "cinder-quobyte-31c04d2f-a320-419c-9884-a48a2096f373" released by "delete_volume" :: held 2.684s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.904s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:08 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Deleted volume successfully.
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c7474221-4b0e-42d7-bdd4-55d5359cc68f tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-80dd2799-46bb-4817-91e5-2e753c308052-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Created reservations ['86902160-3005-4cde-89ae-32dd236df148', 'a6123b73-c6e6-4149-a56c-2e0965270b6e', 'ba1efc3c-e6d9-4593-a4fd-874088aa25e8', '45d336fc-abee-4994-8ec5-3c72361e6dc8'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:08 devstack sudo[105579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:08 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:08 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-846160af-053c-4e4d-b235-8082ab80054b" returned: 0 in 0.887s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-846160af-053c-4e4d-b235-8082ab80054b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:08 devstack sudo[105587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-846160af-053c-4e4d-b235-8082ab80054b
Jul 04 00:16:08 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Acquiring lock "cinder-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Lock "cinder-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:09 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164" returned: 0 in 1.038s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:09 devstack sudo[105589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f
Jul 04 00:16:09 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Acquiring lock "cinder-quobyte-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Lock "cinder-quobyte-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f" acquired by "delete_volume" :: waited 0.038s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc7a833-b5d9-4230-9320-4cca8f9de32f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:09 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:09 devstack sudo[105592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f
Jul 04 00:16:09 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.900s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:09 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Deleted volume successfully.
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-66e2b9c0-bca3-4e7e-ba97-b121868a8158 tempest-VolumeAndVolumeTypeFromImageTest-625204920 None] Lock "cinder-31c04d2f-a320-419c-9884-a48a2096f373-delete_volume" released by "delete_volume" :: held 3.869s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:09 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-846160af-053c-4e4d-b235-8082ab80054b" returned: 0 in 0.949s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-quobyte-846160af-053c-4e4d-b235-8082ab80054b" released by "delete_volume" :: held 1.933s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Created reservations ['36f12264-d8ad-44ee-9132-8fc46444de6c', 'af16d5af-3ba0-4d35-9b4d-140b3db8aad8', '2fc9a311-7ac2-417d-a788-70d9c0d0524f', 'd583a884-7422-4ccc-951a-42c5be360537'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:09 devstack sudo[105598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:09 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:10 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f" returned: 0 in 1.097s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:10 devstack sudo[105604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f
Jul 04 00:16:10 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:10 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f" returned: 0 in 1.030s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:10 devstack sudo[105606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f
Jul 04 00:16:10 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:10 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.013s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:10 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:10 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Deleted volume successfully.
Jul 04 00:16:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4349c081-38be-47d7-9382-f2b62b90d7ee tempest-CreateVolumesFromSourceVolumeTest-1456634468 None] Lock "cinder-846160af-053c-4e4d-b235-8082ab80054b-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:11 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164.d02210f9-a210-4df8-92c8-badcb68bd00f" returned: 0 in 0.930s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Lock "cinder-quobyte-d02210f9-a210-4df8-92c8-badcb68bd00f" released by "_delete_snapshot" :: held 4.255s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Lock "cinder-quobyte-30f5deff-e313-4e33-ac3a-09a277555164" released by "delete_snapshot" :: held 4.288s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:11 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Created reservations ['4dea1845-5cfd-4864-bb11-e6be793e5eb2', '9ed847f8-5f23-4d9e-944b-25b3f95c8e14', '8cf9d0ef-70f5-41ac-810d-41a3410f89d9', '5e7afe6a-b123-4117-b33a-dccbfa837724'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:11 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f" returned: 0 in 1.068s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Lock "cinder-quobyte-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f" released by "delete_volume" :: held 2.173s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:11 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Delete snapshot completed successfully.
Jul 04 00:16:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-31ac13fe-aa3f-45c7-a56b-e2f4c6d7174d tempest-VolumeDependencyTests-193571950 None] Lock "cinder-d02210f9-a210-4df8-92c8-badcb68bd00f-delete_snapshot" released by "delete_snapshot" :: held 4.555s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:11 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Created reservations ['8040f77c-a6ba-44cf-bb65-688554d461e9', 'c59cba55-6320-4d4e-ae47-c0067524be91', '0050a9f3-8835-4129-805f-875e4c9d6794', 'f5f35810-4c40-4d48-84ba-785a7599a577'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:11 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:11 devstack sudo[105611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:11 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Acquiring lock "cinder-30f5deff-e313-4e33-ac3a-09a277555164-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Lock "cinder-30f5deff-e313-4e33-ac3a-09a277555164-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:12 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.868s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:12 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Acquiring lock "cinder-quobyte-30f5deff-e313-4e33-ac3a-09a277555164" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:12 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Deleted volume successfully.
Jul 04 00:16:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Lock "cinder-quobyte-30f5deff-e313-4e33-ac3a-09a277555164" acquired by "delete_volume" :: waited 0.047s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:12 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-62968faa-3440-46b8-a3cb-f4f2bf08aef8 tempest-ProjectReaderTests-681454012 None] Lock "cinder-d09ae6ac-5c87-40e0-9d32-7b1e667ea29f-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:12 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed8b14f-70f5-479a-ae89-f43646c57e43]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:12 devstack sudo[105614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164
Jul 04 00:16:12 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:13 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164" returned: 0 in 0.972s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:13 devstack sudo[105619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164
Jul 04 00:16:13 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:14 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-30f5deff-e313-4e33-ac3a-09a277555164" returned: 0 in 0.859s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Lock "cinder-quobyte-30f5deff-e313-4e33-ac3a-09a277555164" released by "delete_volume" :: held 1.920s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Created reservations ['5bfcf9f9-d60a-42ac-afe1-356afa116d91', '1943dd24-b9cc-43c5-a8be-b524c219330f', 'ea8c45bc-0413-4dba-ac4e-5858557ef517', '7a3155c4-4932-4d63-934d-87d6a6904cb1'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:14 devstack sudo[105623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:14 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Acquiring lock "cinder-3cacd5b5-af43-43a0-95f2-5021ca025bf4-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:14 devstack sudo[105625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:14 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Lock "cinder-3cacd5b5-af43-43a0-95f2-5021ca025bf4-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Acquiring lock "cinder-quobyte-3cacd5b5-af43-43a0-95f2-5021ca025bf4" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Lock "cinder-quobyte-3cacd5b5-af43-43a0-95f2-5021ca025bf4" acquired by "delete_volume" :: waited 0.027s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8dcda5-73ad-4578-a175-70f28c57d3a3]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:15 devstack sudo[105627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4
Jul 04 00:16:15 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:15 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.239s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:16:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:16:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:16:15 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.242s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:15 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Deleted volume successfully.
Jul 04 00:16:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-76a9fb61-deff-46c6-8eb2-54357a0fb5a7 tempest-VolumeDependencyTests-193571950 None] Lock "cinder-30f5deff-e313-4e33-ac3a-09a277555164-delete_volume" released by "delete_volume" :: held 3.635s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Flow 'volume_create_manager' (21c06712-9c90-4885-b611-d0ff7e3ae923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27116256-20b9-48f1-a7a4-af77145891b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27116256-20b9-48f1-a7a4-af77145891b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-108406633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45817018-5f9a-4c8f-9185-1e6306a4a639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79c666251e34e54858d104d31cdee35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:16Z,use_quota=True,user_id='94d6be64d22a434ba521fdfa66eafd14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d27f77b-e3cf-498a-97f9-8d970d2ebb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d27f77b-e3cf-498a-97f9-8d970d2ebb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01d7e6e-6479-4347-b1c4-64973dfb1ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a01d7e6e-6479-4347-b1c4-64973dfb1ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45817018-5f9a-4c8f-9185-1e6306a4a639', 'volume_name': 'volume-45817018-5f9a-4c8f-9185-1e6306a4a639', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda4d937-6c76-4815-a96a-3bf9aad9545f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fda4d937-6c76-4815-a96a-3bf9aad9545f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3d36bc-adb3-4f89-897b-012788c51e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:16 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Volume 45817018-5f9a-4c8f-9185-1e6306a4a639: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45817018-5f9a-4c8f-9185-1e6306a4a639', 'volume_size': 1}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-108406633',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45817018-5f9a-4c8f-9185-1e6306a4a639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79c666251e34e54858d104d31cdee35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:16Z,use_quota=True,user_id='94d6be64d22a434ba521fdfa66eafd14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Creating volume 45817018-5f9a-4c8f-9185-1e6306a4a639 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:16:16 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-45817018-5f9a-4c8f-9185-1e6306a4a639 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:16 devstack sudo[105634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-45817018-5f9a-4c8f-9185-1e6306a4a639 1073741824
Jul 04 00:16:16 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:16 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4" returned: 0 in 1.528s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:16 devstack sudo[105636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4
Jul 04 00:16:16 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Flow 'volume_create_manager' (a516cf80-bbe1-4d31-badd-40b7951aa192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad9b9cb-742a-4545-8410-d0cf91ad1afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad9b9cb-742a-4545-8410-d0cf91ad1afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1082620617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3f86b3-f0c4-4db0-924b-0a2760ecbda9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79c666251e34e54858d104d31cdee35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:17Z,use_quota=True,user_id='94d6be64d22a434ba521fdfa66eafd14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a173976-92e1-4472-808f-8c5ef11a7e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a173976-92e1-4472-808f-8c5ef11a7e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1fc89c-6bbc-4596-ac97-db9d83ad2964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:16 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb1fc89c-6bbc-4596-ac97-db9d83ad2964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c3f86b3-f0c4-4db0-924b-0a2760ecbda9', 'volume_name': 'volume-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb574bc-dd58-485f-a30f-f2f819a1190b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb574bc-dd58-485f-a30f-f2f819a1190b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69aa4422-5b70-4fab-a9ca-fbea6d1c7657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:17 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Volume 0c3f86b3-f0c4-4db0-924b-0a2760ecbda9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9', 'volume_size': 1}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:17 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3cacd5b5-af43-43a0-95f2-5021ca025bf4" returned: 0 in 1.035s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Lock "cinder-quobyte-3cacd5b5-af43-43a0-95f2-5021ca025bf4" released by "delete_volume" :: held 2.667s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Flow 'volume_create_manager' (6aa2197f-32e4-4369-996e-6a05d1d6c440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a193a16-562b-47da-be7a-890557a6ccf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a193a16-562b-47da-be7a-890557a6ccf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2070225386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781daf98-8f18-4000-b355-282784a4913f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79c666251e34e54858d104d31cdee35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:18Z,use_quota=True,user_id='94d6be64d22a434ba521fdfa66eafd14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab27028-9973-4bbc-8782-0a2a3e25f0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ab27028-9973-4bbc-8782-0a2a3e25f0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5473974d-803d-4603-a85e-1f6f9bdc29da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5473974d-803d-4603-a85e-1f6f9bdc29da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '781daf98-8f18-4000-b355-282784a4913f', 'volume_name': 'volume-781daf98-8f18-4000-b355-282784a4913f', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf877308-7c7a-4323-a1af-6d0082ad2b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf877308-7c7a-4323-a1af-6d0082ad2b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d856fa97-c00f-480d-a64e-383b052449e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:17 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Volume 781daf98-8f18-4000-b355-282784a4913f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-781daf98-8f18-4000-b355-282784a4913f', 'volume_size': 1}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Created reservations ['3fc5a8be-fe7d-4175-9e62-4712dd47f97e', '641f9838-a855-4f98-98af-5b54657ce4bb', 'f91b7c69-7c1a-4e1e-a120-fc31ec91d1df', 'a6d7a5ff-6c1c-4665-8b32-8cfeefd1b054'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:17 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-45817018-5f9a-4c8f-9185-1e6306a4a639 1073741824" returned: 0 in 1.696s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-45817018-5f9a-4c8f-9185-1e6306a4a639 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:17 devstack sudo[105642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-45817018-5f9a-4c8f-9185-1e6306a4a639
Jul 04 00:16:17 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:18 devstack sudo[105644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:18 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Flow 'volume_create_manager' (0232dbbd-a366-47fb-a96b-63adbc1650a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15c1893-87bd-4708-9da3-df25aada3788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c15c1893-87bd-4708-9da3-df25aada3788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-293426672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227ea368-7b06-4935-ae08-c09eedf65ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79c666251e34e54858d104d31cdee35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:18Z,use_quota=True,user_id='94d6be64d22a434ba521fdfa66eafd14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a90996-9fe6-41bf-b16f-e3950f3ecf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86a90996-9fe6-41bf-b16f-e3950f3ecf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05aa483f-6ee2-4ba5-bb24-6714b1529ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05aa483f-6ee2-4ba5-bb24-6714b1529ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '227ea368-7b06-4935-ae08-c09eedf65ad2', 'volume_name': 'volume-227ea368-7b06-4935-ae08-c09eedf65ad2', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc57372d-a87f-4b24-a639-cab496718708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc57372d-a87f-4b24-a639-cab496718708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da94b835-571f-4596-91be-7986c39b3df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:18 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Volume 227ea368-7b06-4935-ae08-c09eedf65ad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-227ea368-7b06-4935-ae08-c09eedf65ad2', 'volume_size': 1}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:18 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Flow 'volume_create_manager' (e2db0c4b-37e1-49aa-89c1-de47787f1d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (294c6cfe-d1bf-4dc4-9a98-f99fd1967761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (294c6cfe-d1bf-4dc4-9a98-f99fd1967761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1932066119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acdb7a2c-5dda-498d-b882-d464dfe8c0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79c666251e34e54858d104d31cdee35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:19Z,use_quota=True,user_id='94d6be64d22a434ba521fdfa66eafd14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9564af26-8821-42ad-9de0-d0f9424d1f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9564af26-8821-42ad-9de0-d0f9424d1f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89c7c61-e96e-48db-8227-524bb5b25666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a89c7c61-e96e-48db-8227-524bb5b25666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acdb7a2c-5dda-498d-b882-d464dfe8c0c0', 'volume_name': 'volume-acdb7a2c-5dda-498d-b882-d464dfe8c0c0', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db950f21-fced-45db-a08e-c9b1ca9927c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db950f21-fced-45db-a08e-c9b1ca9927c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269c5d34-5511-4bcc-9a73-633f1ff9ee9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:19 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Volume acdb7a2c-5dda-498d-b882-d464dfe8c0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acdb7a2c-5dda-498d-b882-d464dfe8c0c0', 'volume_size': 1}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:19 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-45817018-5f9a-4c8f-9185-1e6306a4a639" returned: 0 in 1.271s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] <== create_volume: return (3053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.057s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.171s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1082620617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c3f86b3-f0c4-4db0-924b-0a2760ecbda9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79c666251e34e54858d104d31cdee35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:17Z,use_quota=True,user_id='94d6be64d22a434ba521fdfa66eafd14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Creating volume 0c3f86b3-f0c4-4db0-924b-0a2760ecbda9 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:16:19 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:19 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.250s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:19 devstack sudo[105648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9 1073741824
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:19 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3d36bc-adb3-4f89-897b-012788c51e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45817018-5f9a-4c8f-9185-1e6306a4a639', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e25a8db-af64-4efa-9242-ba185cbf0b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:19 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Deleted volume successfully.
Jul 04 00:16:19 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Volume volume-45817018-5f9a-4c8f-9185-1e6306a4a639 (45817018-5f9a-4c8f-9185-1e6306a4a639): created successfully
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e25a8db-af64-4efa-9242-ba185cbf0b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Flow 'volume_create_manager' (21c06712-9c90-4885-b611-d0ff7e3ae923) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-67939a19-fee9-432e-b272-7320e503df1b tempest-VolumeDependencyTests-193571950 None] Lock "cinder-3cacd5b5-af43-43a0-95f2-5021ca025bf4-delete_volume" released by "delete_volume" :: held 4.650s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:19 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-78768878-c802-4bfc-98c5-dfe0e3d11aa1 tempest-CreateVolumesFromImageTest-180562366 None] Created volume successfully.
Jul 04 00:16:20 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9 1073741824" returned: 0 in 1.281s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:20 devstack sudo[105654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9
Jul 04 00:16:20 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:21 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9" returned: 0 in 0.928s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] <== create_volume: return (2312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.318s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.771s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2070225386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=781daf98-8f18-4000-b355-282784a4913f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79c666251e34e54858d104d31cdee35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:18Z,use_quota=True,user_id='94d6be64d22a434ba521fdfa66eafd14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Creating volume 781daf98-8f18-4000-b355-282784a4913f {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:16:21 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-781daf98-8f18-4000-b355-282784a4913f 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69aa4422-5b70-4fab-a9ca-fbea6d1c7657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:21 devstack sudo[105657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-781daf98-8f18-4000-b355-282784a4913f 1073741824
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b97b947-af04-4a1f-9826-3c4f71edddce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:21 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:21 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Volume volume-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9 (0c3f86b3-f0c4-4db0-924b-0a2760ecbda9): created successfully
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b97b947-af04-4a1f-9826-3c4f71edddce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Flow 'volume_create_manager' (a516cf80-bbe1-4d31-badd-40b7951aa192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:21 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3d4b386c-6d3f-444f-bc02-d0660ba0e049 tempest-CreateVolumesFromImageTest-180562366 None] Created volume successfully.
Jul 04 00:16:22 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-781daf98-8f18-4000-b355-282784a4913f 1073741824" returned: 0 in 1.179s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-781daf98-8f18-4000-b355-282784a4913f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:22 devstack sudo[105663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-781daf98-8f18-4000-b355-282784a4913f
Jul 04 00:16:22 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:23 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-781daf98-8f18-4000-b355-282784a4913f" returned: 0 in 0.837s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.277s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-293426672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=227ea368-7b06-4935-ae08-c09eedf65ad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79c666251e34e54858d104d31cdee35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:18Z,use_quota=True,user_id='94d6be64d22a434ba521fdfa66eafd14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Creating volume 227ea368-7b06-4935-ae08-c09eedf65ad2 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:16:23 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-227ea368-7b06-4935-ae08-c09eedf65ad2 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d856fa97-c00f-480d-a64e-383b052449e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-781daf98-8f18-4000-b355-282784a4913f', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be767238-1d30-40b0-81a5-8d66abbdc80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:23 devstack sudo[105666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-227ea368-7b06-4935-ae08-c09eedf65ad2 1073741824
Jul 04 00:16:23 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:23 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Volume volume-781daf98-8f18-4000-b355-282784a4913f (781daf98-8f18-4000-b355-282784a4913f): created successfully
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be767238-1d30-40b0-81a5-8d66abbdc80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Flow 'volume_create_manager' (6aa2197f-32e4-4369-996e-6a05d1d6c440) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:23 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-36d1a076-d5e9-4170-baa6-2fe6fc85a060 tempest-CreateVolumesFromImageTest-180562366 None] Created volume successfully.
Jul 04 00:16:24 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-227ea368-7b06-4935-ae08-c09eedf65ad2 1073741824" returned: 0 in 1.255s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-227ea368-7b06-4935-ae08-c09eedf65ad2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:24 devstack sudo[105674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-227ea368-7b06-4935-ae08-c09eedf65ad2
Jul 04 00:16:24 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:25 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-227ea368-7b06-4935-ae08-c09eedf65ad2" returned: 0 in 0.896s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] <== create_volume: return (2205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.724s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1932066119',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acdb7a2c-5dda-498d-b882-d464dfe8c0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d79c666251e34e54858d104d31cdee35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:19Z,use_quota=True,user_id='94d6be64d22a434ba521fdfa66eafd14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Creating volume acdb7a2c-5dda-498d-b882-d464dfe8c0c0 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:16:25 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-acdb7a2c-5dda-498d-b882-d464dfe8c0c0 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da94b835-571f-4596-91be-7986c39b3df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-227ea368-7b06-4935-ae08-c09eedf65ad2', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b934c7-810f-43ca-b543-4bd5e577b8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:25 devstack sudo[105677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-acdb7a2c-5dda-498d-b882-d464dfe8c0c0 1073741824
Jul 04 00:16:25 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:25 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Volume volume-227ea368-7b06-4935-ae08-c09eedf65ad2 (227ea368-7b06-4935-ae08-c09eedf65ad2): created successfully
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b934c7-810f-43ca-b543-4bd5e577b8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:25 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Flow 'volume_create_manager' (0232dbbd-a366-47fb-a96b-63adbc1650a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:25 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-0a694830-ea22-4f78-88ab-373f12f2bb60 tempest-CreateVolumesFromImageTest-180562366 None] Created volume successfully.
Jul 04 00:16:26 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:26 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Flow 'volume_create_manager' (734213f6-b3e5-41c4-ab6c-293be1077479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b542f50-2f08-4f1d-abec-9fbbbcc789d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:27 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-acdb7a2c-5dda-498d-b882-d464dfe8c0c0 1073741824" returned: 0 in 1.219s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b542f50-2f08-4f1d-abec-9fbbbcc789d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-193028013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a963630d-bb73-426a-b252-ebd572248bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841bae223719475fb77da67fc2699ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:27Z,use_quota=True,user_id='215244158ed747a1a49c5037fbb69472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15c136f-c383-47ba-b713-f7855f80f942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a15c136f-c383-47ba-b713-f7855f80f942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0461acdc-b0a6-448f-bb48-5d2d6172d2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0461acdc-b0a6-448f-bb48-5d2d6172d2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a963630d-bb73-426a-b252-ebd572248bbb', 'volume_name': 'volume-a963630d-bb73-426a-b252-ebd572248bbb', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed1d733-45e5-430a-a871-7f60949c0f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed1d733-45e5-430a-a871-7f60949c0f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31836afb-7033-4e65-9daa-03e595a0082c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:27 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Volume a963630d-bb73-426a-b252-ebd572248bbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a963630d-bb73-426a-b252-ebd572248bbb', 'volume_size': 1}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-acdb7a2c-5dda-498d-b882-d464dfe8c0c0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:27 devstack sudo[105685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-acdb7a2c-5dda-498d-b882-d464dfe8c0c0
Jul 04 00:16:27 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:27 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-acdb7a2c-5dda-498d-b882-d464dfe8c0c0" returned: 0 in 0.764s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.090s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.805s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-193028013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a963630d-bb73-426a-b252-ebd572248bbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841bae223719475fb77da67fc2699ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:27Z,use_quota=True,user_id='215244158ed747a1a49c5037fbb69472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Creating volume a963630d-bb73-426a-b252-ebd572248bbb {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:16:27 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a963630d-bb73-426a-b252-ebd572248bbb 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:27 devstack sudo[105688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a963630d-bb73-426a-b252-ebd572248bbb 1073741824
Jul 04 00:16:27 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269c5d34-5511-4bcc-9a73-633f1ff9ee9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acdb7a2c-5dda-498d-b882-d464dfe8c0c0', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d58fbc8-dcf6-4a2e-864c-2de5b0ca0349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:27 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Volume volume-acdb7a2c-5dda-498d-b882-d464dfe8c0c0 (acdb7a2c-5dda-498d-b882-d464dfe8c0c0): created successfully
Jul 04 00:16:27 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d58fbc8-dcf6-4a2e-864c-2de5b0ca0349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Flow 'volume_create_manager' (e2db0c4b-37e1-49aa-89c1-de47787f1d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:28 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-8d161387-083f-43c5-b499-5b01df1edfb9 tempest-CreateVolumesFromImageTest-180562366 None] Created volume successfully.
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Flow 'volume_create_manager' (8c87efaa-cb44-4504-8278-58299f86b57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145cc601-8b5f-4e64-ba76-906e86fc02c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145cc601-8b5f-4e64-ba76-906e86fc02c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189793b2-a0aa-42b9-934b-3e4733ed21ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a287a3ea0f4d55bcde86cdeee19f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:28Z,use_quota=True,user_id='bd82f772e0cb486ab28f9a456b7fda6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5808f6f7-2fa4-4bea-902b-60daace4ff47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5808f6f7-2fa4-4bea-902b-60daace4ff47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0136fc-c42c-47c7-835f-2f03c6d6c941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG cinder.image.glance [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Creating Keystone auth plugin from conf {{(pid=86650) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0136fc-c42c-47c7-835f-2f03c6d6c941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '189793b2-a0aa-42b9-934b-3e4733ed21ed', 'volume_name': 'volume-189793b2-a0aa-42b9-934b-3e4733ed21ed', 'volume_size': 1, 'image_id': 'e2380322-f9fc-4c42-886d-943a854d8347', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2380322-f9fc-4c42-886d-943a854d8347', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '91b09efefbd6b92eb6a4365304523768', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '89a287a3ea0f4d55bcde86cdeee19f9f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '62fec629349f69e079309c33d0995ae83c8ca4409e70862f0d564c2538b164605f3ea21f209fbdbbcd7247e0f1a9ec34ac92180898963f836ab400fe64431bfa', 'id': 'e2380322-f9fc-4c42-886d-943a854d8347', 'created_at': datetime.datetime(2026, 7, 3, 22, 16, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 16, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2380322-f9fc-4c42-886d-943a854d8347/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000cd82c0>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e600bce7-783d-402a-87a5-f4483162f239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e600bce7-783d-402a-87a5-f4483162f239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11be7bc-538b-4ee5-87da-1c6ac9362003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:28 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Volume 189793b2-a0aa-42b9-934b-3e4733ed21ed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-189793b2-a0aa-42b9-934b-3e4733ed21ed', 'volume_size': 1, 'image_id': 'e2380322-f9fc-4c42-886d-943a854d8347', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2380322-f9fc-4c42-886d-943a854d8347', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '91b09efefbd6b92eb6a4365304523768', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '89a287a3ea0f4d55bcde86cdeee19f9f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '62fec629349f69e079309c33d0995ae83c8ca4409e70862f0d564c2538b164605f3ea21f209fbdbbcd7247e0f1a9ec34ac92180898963f836ab400fe64431bfa', 'id': 'e2380322-f9fc-4c42-886d-943a854d8347', 'created_at': datetime.datetime(2026, 7, 3, 22, 16, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 16, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2380322-f9fc-4c42-886d-943a854d8347/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000cd82c0>}
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Trying to clone 189793b2-a0aa-42b9-934b-3e4733ed21ed from image e2380322-f9fc-4c42-886d-943a854d8347 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e2380322-f9fc-4c42-886d-943a854d8347', 'metadata': {}}]). {{(pid=86650) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 04 00:16:28 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Image download 0.00 MB at 0.00 MB/s
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c3b500-100e-4b2b-ad9a-325fd4394c9a]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:28 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a963630d-bb73-426a-b252-ebd572248bbb 1073741824" returned: 0 in 1.031s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:28 devstack sudo[105694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD
Jul 04 00:16:28 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a963630d-bb73-426a-b252-ebd572248bbb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:29 devstack sudo[105696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a963630d-bb73-426a-b252-ebd572248bbb
Jul 04 00:16:29 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "cinder-acdb7a2c-5dda-498d-b882-d464dfe8c0c0-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-acdb7a2c-5dda-498d-b882-d464dfe8c0c0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "cinder-quobyte-acdb7a2c-5dda-498d-b882-d464dfe8c0c0" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-quobyte-acdb7a2c-5dda-498d-b882-d464dfe8c0c0" acquired by "delete_volume" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:29 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4637317-b088-470f-b2c7-c1b6f169056e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-acdb7a2c-5dda-498d-b882-d464dfe8c0c0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:29 devstack sudo[105698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-acdb7a2c-5dda-498d-b882-d464dfe8c0c0
Jul 04 00:16:29 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:29 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a963630d-bb73-426a-b252-ebd572248bbb" returned: 0 in 0.837s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:16:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31836afb-7033-4e65-9daa-03e595a0082c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a963630d-bb73-426a-b252-ebd572248bbb', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661f48d3-ccac-4a1d-963f-47e8b7e42395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:29 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Volume volume-a963630d-bb73-426a-b252-ebd572248bbb (a963630d-bb73-426a-b252-ebd572248bbb): created successfully
Jul 04 00:16:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661f48d3-ccac-4a1d-963f-47e8b7e42395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Flow 'volume_create_manager' (734213f6-b3e5-41c4-ab6c-293be1077479) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:29 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9f729c63-da4f-4ea8-aa9a-119b5452b295 tempest-ProjectReaderTests-95017493 None] Created volume successfully.
Jul 04 00:16:29 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD" returned: 0 in 1.177s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:30 devstack sudo[105703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD
Jul 04 00:16:30 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:30 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-acdb7a2c-5dda-498d-b882-d464dfe8c0c0" returned: 0 in 1.016s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-acdb7a2c-5dda-498d-b882-d464dfe8c0c0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:30 devstack sudo[105709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-acdb7a2c-5dda-498d-b882-d464dfe8c0c0
Jul 04 00:16:30 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Acquiring lock "cinder-a963630d-bb73-426a-b252-ebd572248bbb-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Lock "cinder-a963630d-bb73-426a-b252-ebd572248bbb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Acquiring lock "cinder-quobyte-a963630d-bb73-426a-b252-ebd572248bbb" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Lock "cinder-quobyte-a963630d-bb73-426a-b252-ebd572248bbb" acquired by "delete_volume" :: waited 0.033s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:30 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c55b28-459c-4312-a9bd-8b90b8e617f9]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a963630d-bb73-426a-b252-ebd572248bbb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:30 devstack sudo[105711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a963630d-bb73-426a-b252-ebd572248bbb
Jul 04 00:16:30 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:30 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD" returned: 1 in 0.904s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:16:30 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Temporary image e2380322-f9fc-4c42-886d-943a854d8347 is fetched for user bd82f772e0cb486ab28f9a456b7fda6a. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 04 00:16:30 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa90ee6-7f92-4ae5-be89-a2838e657a1d]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:31 devstack sudo[105716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD
Jul 04 00:16:31 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:31 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-acdb7a2c-5dda-498d-b882-d464dfe8c0c0" returned: 0 in 0.858s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-quobyte-acdb7a2c-5dda-498d-b882-d464dfe8c0c0" released by "delete_volume" :: held 1.931s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Created reservations ['81b76ecf-3161-4571-9d72-c2d2fc4ef1c2', '3820e982-85fa-4bdb-8f92-75199fe5c5f7', 'b2047d70-d470-4fe8-89f1-eb965e6eea71', '4360c692-748f-45ea-b9f1-3bf9f64488ac'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:31 devstack sudo[105720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:31 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "cinder-227ea368-7b06-4935-ae08-c09eedf65ad2-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-227ea368-7b06-4935-ae08-c09eedf65ad2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "cinder-quobyte-227ea368-7b06-4935-ae08-c09eedf65ad2" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:31 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a963630d-bb73-426a-b252-ebd572248bbb" returned: 0 in 1.173s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a963630d-bb73-426a-b252-ebd572248bbb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-quobyte-227ea368-7b06-4935-ae08-c09eedf65ad2" acquired by "delete_volume" :: waited 0.038s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e5bed5-40e4-4476-854c-866ae7a709f1]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:31 devstack sudo[105725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a963630d-bb73-426a-b252-ebd572248bbb
Jul 04 00:16:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-227ea368-7b06-4935-ae08-c09eedf65ad2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:31 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:31 devstack sudo[105727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-227ea368-7b06-4935-ae08-c09eedf65ad2
Jul 04 00:16:31 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:32 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD" returned: 0 in 1.059s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:32 devstack sudo[105731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD
Jul 04 00:16:32 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:32 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.874s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:32 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Deleted volume successfully.
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eceac7a8-d44f-4f94-a9a8-1ec23ed7329a tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-acdb7a2c-5dda-498d-b882-d464dfe8c0c0-delete_volume" released by "delete_volume" :: held 3.159s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:32 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a963630d-bb73-426a-b252-ebd572248bbb" returned: 0 in 0.912s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Lock "cinder-quobyte-a963630d-bb73-426a-b252-ebd572248bbb" released by "delete_volume" :: held 2.145s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=103,cinder:UPDATE=159,cinder:DELETE=12,cinder:INSERT=38 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Created reservations ['6149838a-0b54-495f-b859-e336c0e5efaf', 'a87197ca-ab53-4642-a8d9-4f069cb4094f', '403d31fe-869e-4475-9525-41b16bad46ab', 'fd3befee-3143-4939-8f64-f187c9243a87'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:32 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-227ea368-7b06-4935-ae08-c09eedf65ad2" returned: 0 in 1.060s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-227ea368-7b06-4935-ae08-c09eedf65ad2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:32 devstack sudo[105739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:32 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:32 devstack sudo[105740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-227ea368-7b06-4935-ae08-c09eedf65ad2
Jul 04 00:16:32 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:33 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD" returned: 1 in 1.064s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=189793b2-a0aa-42b9-934b-3e4733ed21ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89a287a3ea0f4d55bcde86cdeee19f9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:28Z,use_quota=True,user_id='bd82f772e0cb486ab28f9a456b7fda6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Creating volume 189793b2-a0aa-42b9-934b-3e4733ed21ed {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:16:33 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:33 devstack sudo[105746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed 1073741824
Jul 04 00:16:33 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:33 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.828s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:33 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Deleted volume successfully.
Jul 04 00:16:33 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-227ea368-7b06-4935-ae08-c09eedf65ad2" returned: 0 in 0.836s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-761af5e3-ff8c-4a0b-915f-20a426e70521 tempest-ProjectReaderTests-95017493 None] Lock "cinder-a963630d-bb73-426a-b252-ebd572248bbb-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-quobyte-227ea368-7b06-4935-ae08-c09eedf65ad2" released by "delete_volume" :: held 1.958s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=163,cinder:SELECT=132,cinder:INSERT=44,cinder:DELETE=18 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Created reservations ['50d3312a-cb86-4db9-9a0c-53177f183408', 'c581c2f1-bf8d-4f7d-a7bf-7d481d1fea5b', '58f49f23-3e8f-41bf-a188-0345e42000d0', 'b317db5b-d1f2-4d5b-ad68-af14a423c10b'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:33 devstack sudo[105754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:33 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "cinder-781daf98-8f18-4000-b355-282784a4913f-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-781daf98-8f18-4000-b355-282784a4913f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "cinder-quobyte-781daf98-8f18-4000-b355-282784a4913f" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-quobyte-781daf98-8f18-4000-b355-282784a4913f" acquired by "delete_volume" :: waited 0.048s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:34 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f36c162-394a-41f7-9cef-da1c2bf0ac76]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-781daf98-8f18-4000-b355-282784a4913f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:34 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed 1073741824" returned: 0 in 1.394s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:34 devstack sudo[105758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed
Jul 04 00:16:34 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:34 devstack sudo[105757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-781daf98-8f18-4000-b355-282784a4913f
Jul 04 00:16:34 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:34 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.986s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:34 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:34 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Deleted volume successfully.
Jul 04 00:16:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d0ed333c-de1d-449c-a442-0b22781371cc tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-227ea368-7b06-4935-ae08-c09eedf65ad2-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Flow 'volume_create_manager' (93faee0d-2269-4048-8d13-9aa45739f0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c250d241-7e42-4334-8f72-53381bfac863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c250d241-7e42-4334-8f72-53381bfac863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1592574813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e983967-d43b-47c8-8ede-9c26451ef075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841bae223719475fb77da67fc2699ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:35Z,use_quota=True,user_id='215244158ed747a1a49c5037fbb69472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c536c2c-7a76-4039-9f55-761fe2557a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c536c2c-7a76-4039-9f55-761fe2557a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb736f1d-16b9-4065-9ae0-aba65b277851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb736f1d-16b9-4065-9ae0-aba65b277851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e983967-d43b-47c8-8ede-9c26451ef075', 'volume_name': 'volume-7e983967-d43b-47c8-8ede-9c26451ef075', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19465e98-01d6-46b4-a42f-b9555d3b3175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19465e98-01d6-46b4-a42f-b9555d3b3175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be889322-a837-4c70-9470-5efe0f775ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:35 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Volume 7e983967-d43b-47c8-8ede-9c26451ef075: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e983967-d43b-47c8-8ede-9c26451ef075', 'volume_size': 1}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:35 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed" returned: 0 in 0.893s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] <== create_volume: return (2366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.369s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.256s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1592574813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e983967-d43b-47c8-8ede-9c26451ef075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841bae223719475fb77da67fc2699ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:35Z,use_quota=True,user_id='215244158ed747a1a49c5037fbb69472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Creating volume 7e983967-d43b-47c8-8ede-9c26451ef075 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:16:35 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7e983967-d43b-47c8-8ede-9c26451ef075 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:35 devstack sudo[105768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7e983967-d43b-47c8-8ede-9c26451ef075 1073741824
Jul 04 00:16:35 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Attempting download of e2380322-f9fc-4c42-886d-943a854d8347 ((None, [{'url': 'file:///opt/stack/data/glance/images/e2380322-f9fc-4c42-886d-943a854d8347', 'metadata': {}}])) to volume 189793b2-a0aa-42b9-934b-3e4733ed21ed. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 04 00:16:35 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-781daf98-8f18-4000-b355-282784a4913f" returned: 0 in 1.117s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-781daf98-8f18-4000-b355-282784a4913f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:35 devstack sudo[105770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-781daf98-8f18-4000-b355-282784a4913f
Jul 04 00:16:35 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b178836c-2c83-420b-beba-181d22912a36]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2380322-f9fc-4c42-886d-943a854d8347_9t2ei5kj {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:35 devstack sudo[105772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2380322-f9fc-4c42-886d-943a854d8347_9t2ei5kj
Jul 04 00:16:35 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:36 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e2380322-f9fc-4c42-886d-943a854d8347_9t2ei5kj" returned: 0 in 0.994s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2380322-f9fc-4c42-886d-943a854d8347_9t2ei5kj {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:36 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-781daf98-8f18-4000-b355-282784a4913f" returned: 0 in 1.092s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-quobyte-781daf98-8f18-4000-b355-282784a4913f" released by "delete_volume" :: held 2.291s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:36 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7e983967-d43b-47c8-8ede-9c26451ef075 1073741824" returned: 0 in 1.297s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:36 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Created reservations ['02635570-7b1c-4564-973f-fdb7655582f4', 'f33c3133-6d8b-445b-96b1-df8cbb2cbd26', '683b9c7d-b4a7-4b0c-9cab-5816357fa59a', '8a5f6414-12ff-4750-8013-59349ee366cb'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7e983967-d43b-47c8-8ede-9c26451ef075 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:36 devstack sudo[105781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2380322-f9fc-4c42-886d-943a854d8347_9t2ei5kj
Jul 04 00:16:36 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:36 devstack sudo[105782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7e983967-d43b-47c8-8ede-9c26451ef075
Jul 04 00:16:36 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:37 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:37 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:37 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:37 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "cinder-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "cinder-quobyte-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-quobyte-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9" acquired by "delete_volume" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:37 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcacd1a2-d0fd-4b05-aedd-56d4b9d068c2]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:38 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:38 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7e983967-d43b-47c8-8ede-9c26451ef075" returned: 0 in 1.176s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] <== create_volume: return (2544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:16:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.550s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:38 devstack sudo[105790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9
Jul 04 00:16:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.018s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:38 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:38 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:38 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:38 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Deleted volume successfully.
Jul 04 00:16:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2380322-f9fc-4c42-886d-943a854d8347_9t2ei5kj" returned: 1 in 1.390s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e2380322-f9fc-4c42-886d-943a854d8347_9t2ei5kj' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:16:38 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49d6b3b-252a-4d60-9246-4850ea2035af]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be889322-a837-4c70-9470-5efe0f775ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e983967-d43b-47c8-8ede-9c26451ef075', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b29756-a093-4dcf-88c0-3385dc297c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-11efd205-5a66-458b-80af-fd72dd308443 tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-781daf98-8f18-4000-b355-282784a4913f-delete_volume" released by "delete_volume" :: held 3.973s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:38 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Volume volume-7e983967-d43b-47c8-8ede-9c26451ef075 (7e983967-d43b-47c8-8ede-9c26451ef075): created successfully
Jul 04 00:16:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b29756-a093-4dcf-88c0-3385dc297c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:38 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Flow 'volume_create_manager' (93faee0d-2269-4048-8d13-9aa45739f0e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:38 devstack sudo[105794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD
Jul 04 00:16:38 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:38 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-783db936-d6b7-4ea7-8737-a7c730209396 tempest-ProjectReaderTests-95017493 None] Created volume successfully.
Jul 04 00:16:38 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9" returned: 0 in 1.099s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:39 devstack sudo[105802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9
Jul 04 00:16:39 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:39 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD" returned: 0 in 0.979s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:39 devstack sudo[105804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD
Jul 04 00:16:39 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Acquiring lock "cinder-7e983967-d43b-47c8-8ede-9c26451ef075-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Lock "cinder-7e983967-d43b-47c8-8ede-9c26451ef075-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Acquiring lock "cinder-quobyte-7e983967-d43b-47c8-8ede-9c26451ef075" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Lock "cinder-quobyte-7e983967-d43b-47c8-8ede-9c26451ef075" acquired by "delete_volume" :: waited 0.030s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:39 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a928a8b-1935-48fe-af09-ad69ca54465a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7e983967-d43b-47c8-8ede-9c26451ef075 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:39 devstack sudo[105806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7e983967-d43b-47c8-8ede-9c26451ef075
Jul 04 00:16:39 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:39 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9" returned: 0 in 0.993s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-quobyte-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9" released by "delete_volume" :: held 2.164s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:40 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Created reservations ['a4007cea-ca70-4b23-880a-9e3edcf43138', '75c96f4a-d9c8-4532-9475-eb9a96544926', '64b87d9a-82a8-4ee6-9be4-fdd4b6c726cf', '2b3700ac-e52e-413e-bf31-52f50ad5d7fd'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:40 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:40 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD" returned: 1 in 1.080s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:16:40 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] e2380322-f9fc-4c42-886d-943a854d8347 was raw, converting to raw {{(pid=86650) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 04 00:16:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:40 devstack sudo[105812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:40 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:40 devstack sudo[105813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed
Jul 04 00:16:40 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7e983967-d43b-47c8-8ede-9c26451ef075" returned: 0 in 0.975s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7e983967-d43b-47c8-8ede-9c26451ef075 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:40 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:40 devstack sudo[105819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7e983967-d43b-47c8-8ede-9c26451ef075
Jul 04 00:16:40 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:40 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.812s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:40 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:40 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Deleted volume successfully.
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f359ae6d-9d4b-4640-909e-95bf655e942e tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-0c3f86b3-f0c4-4db0-924b-0a2760ecbda9-delete_volume" released by "delete_volume" :: held 3.285s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:41 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "cinder-45817018-5f9a-4c8f-9185-1e6306a4a639-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed" returned: 0 in 0.992s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e2380322-f9fc-4c42-886d-943a854d8347_zhhqi8wddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:16:41 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Converted 0.00 MB image at 0.00 MB/s
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-45817018-5f9a-4c8f-9185-1e6306a4a639-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:41 devstack sudo[105825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed 1G
Jul 04 00:16:41 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "cinder-quobyte-45817018-5f9a-4c8f-9185-1e6306a4a639" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-quobyte-45817018-5f9a-4c8f-9185-1e6306a4a639" acquired by "delete_volume" :: waited 0.028s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf131e51-10dc-4346-a386-73b8df7b70c1]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-45817018-5f9a-4c8f-9185-1e6306a4a639 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:41 devstack sudo[105828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-45817018-5f9a-4c8f-9185-1e6306a4a639
Jul 04 00:16:41 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:41 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7e983967-d43b-47c8-8ede-9c26451ef075" returned: 0 in 0.857s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Lock "cinder-quobyte-7e983967-d43b-47c8-8ede-9c26451ef075" released by "delete_volume" :: held 1.888s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Created reservations ['c78d23d9-1bd2-47de-8cbb-9e7eb004d7d1', '07fc9d92-383c-41cc-a43d-4e7fe2465200', '2df78834-33bd-4f55-8e32-bebfc9a83af2', '3655b995-d735-40ec-981d-a174ac3cbf51'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:41 devstack sudo[105830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:41 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:42 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed 1G" returned: 0 in 1.026s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaed6c41-8144-472b-ab3b-ee025daf6a66]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:42 devstack sudo[105835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed
Jul 04 00:16:42 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:42 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-45817018-5f9a-4c8f-9185-1e6306a4a639" returned: 0 in 1.302s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-45817018-5f9a-4c8f-9185-1e6306a4a639 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:42 devstack sudo[105840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-45817018-5f9a-4c8f-9185-1e6306a4a639
Jul 04 00:16:42 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Flow 'volume_create_manager' (f9177a98-1cdb-4c64-b3cb-c3bd0c1d4513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e29a38-6861-4e3e-823e-ddf67bee28e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:42 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.068s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:42 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Deleted volume successfully.
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2e29a38-6861-4e3e-823e-ddf67bee28e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1639750270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6090dd2-ccb9-4220-ac6e-66bd048b0e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841bae223719475fb77da67fc2699ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:43Z,use_quota=True,user_id='215244158ed747a1a49c5037fbb69472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a377416-178c-4f00-8ce6-b08ce2a311c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a377416-178c-4f00-8ce6-b08ce2a311c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d6c35b-cc9b-44e7-a679-db93dfc07759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d6c35b-cc9b-44e7-a679-db93dfc07759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6090dd2-ccb9-4220-ac6e-66bd048b0e22', 'volume_name': 'volume-a6090dd2-ccb9-4220-ac6e-66bd048b0e22', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f44d87d-6449-4971-806f-004823ef9e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f44d87d-6449-4971-806f-004823ef9e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811c3231-2ddd-495b-afae-13f197fae7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:42 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Volume a6090dd2-ccb9-4220-ac6e-66bd048b0e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6090dd2-ccb9-4220-ac6e-66bd048b0e22', 'volume_size': 1}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1639750270',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6090dd2-ccb9-4220-ac6e-66bd048b0e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841bae223719475fb77da67fc2699ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:43Z,use_quota=True,user_id='215244158ed747a1a49c5037fbb69472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Creating volume a6090dd2-ccb9-4220-ac6e-66bd048b0e22 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:16:42 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:16:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a6090dd2-ccb9-4220-ac6e-66bd048b0e22 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7b069180-b937-48f6-bb57-1d572751b02c tempest-ProjectReaderTests-95017493 None] Lock "cinder-7e983967-d43b-47c8-8ede-9c26451ef075-delete_volume" released by "delete_volume" :: held 3.433s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:43 devstack sudo[105844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a6090dd2-ccb9-4220-ac6e-66bd048b0e22 1073741824
Jul 04 00:16:43 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:43 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed" returned: 0 in 0.988s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:43 devstack sudo[105848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed
Jul 04 00:16:43 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:43 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-45817018-5f9a-4c8f-9185-1e6306a4a639" returned: 0 in 0.879s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-quobyte-45817018-5f9a-4c8f-9185-1e6306a4a639" released by "delete_volume" :: held 2.292s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:43 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Created reservations ['d8289bef-3912-4fe8-9de9-59ae6860d046', '43adc001-ad28-42e8-abb7-e148ef96b437', 'd2164850-e432-4a0d-beb8-9da87bd083d1', '5db6f048-8cf6-46ba-bfa5-41d5d7d009ee'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:43 devstack sudo[105854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:43 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:44 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a6090dd2-ccb9-4220-ac6e-66bd048b0e22 1073741824" returned: 0 in 1.144s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a6090dd2-ccb9-4220-ac6e-66bd048b0e22 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:44 devstack sudo[105860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a6090dd2-ccb9-4220-ac6e-66bd048b0e22
Jul 04 00:16:44 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:44 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed" returned: 1 in 1.055s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Downloaded image e2380322-f9fc-4c42-886d-943a854d8347 ((None, [{'url': 'file:///opt/stack/data/glance/images/e2380322-f9fc-4c42-886d-943a854d8347', 'metadata': {}}])) to volume 189793b2-a0aa-42b9-934b-3e4733ed21ed successfully. {{(pid=86650) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Temporary image e2380322-f9fc-4c42-886d-943a854d8347 for user bd82f772e0cb486ab28f9a456b7fda6a is deleted. {{(pid=86650) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG cinder.volume.volume_utils [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Marking volume 189793b2-a0aa-42b9-934b-3e4733ed21ed as bootable. {{(pid=86650) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Copying metadata from image e2380322-f9fc-4c42-886d-943a854d8347 to 189793b2-a0aa-42b9-934b-3e4733ed21ed. {{(pid=86650) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Creating volume glance metadata for volume 189793b2-a0aa-42b9-934b-3e4733ed21ed backed by image e2380322-f9fc-4c42-886d-943a854d8347 with: {'image_id': 'e2380322-f9fc-4c42-886d-943a854d8347', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '91b09efefbd6b92eb6a4365304523768', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86650) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d11be7bc-538b-4ee5-87da-1c6ac9362003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-189793b2-a0aa-42b9-934b-3e4733ed21ed', 'volume_size': 1, 'image_id': 'e2380322-f9fc-4c42-886d-943a854d8347', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e2380322-f9fc-4c42-886d-943a854d8347', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '91b09efefbd6b92eb6a4365304523768', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '89a287a3ea0f4d55bcde86cdeee19f9f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '62fec629349f69e079309c33d0995ae83c8ca4409e70862f0d564c2538b164605f3ea21f209fbdbbcd7247e0f1a9ec34ac92180898963f836ab400fe64431bfa', 'id': 'e2380322-f9fc-4c42-886d-943a854d8347', 'created_at': datetime.datetime(2026, 7, 3, 22, 16, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 3, 22, 16, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e2380322-f9fc-4c42-886d-943a854d8347/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x75b000cd82c0>}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28f2e41-acff-4f1e-9e23-97f7dcaaef97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:44 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Volume volume-189793b2-a0aa-42b9-934b-3e4733ed21ed (189793b2-a0aa-42b9-934b-3e4733ed21ed): created successfully
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28f2e41-acff-4f1e-9e23-97f7dcaaef97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Flow 'volume_create_manager' (8c87efaa-cb44-4504-8278-58299f86b57e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6ade5c39-0e38-43ee-b3a2-361c9a8cdcc7 tempest-VolumeImageDependencyTests-221989484 None] Created volume successfully.
Jul 04 00:16:44 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.848s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Deleted volume successfully.
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-bc06bd72-72b3-4549-ba49-d7f36c6e61dd tempest-CreateVolumesFromImageTest-180562366 None] Lock "cinder-45817018-5f9a-4c8f-9185-1e6306a4a639-delete_volume" released by "delete_volume" :: held 3.493s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Acquiring lock "cinder-189793b2-a0aa-42b9-934b-3e4733ed21ed-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:44 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Lock "cinder-189793b2-a0aa-42b9-934b-3e4733ed21ed-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:45 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a6090dd2-ccb9-4220-ac6e-66bd048b0e22" returned: 0 in 0.881s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:45 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:16:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Acquiring lock "cinder-quobyte-189793b2-a0aa-42b9-934b-3e4733ed21ed" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (811c3231-2ddd-495b-afae-13f197fae7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6090dd2-ccb9-4220-ac6e-66bd048b0e22', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb52f73a-2384-40af-868d-bbd4a69e8993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:45 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Lock "cinder-quobyte-189793b2-a0aa-42b9-934b-3e4733ed21ed" acquired by "delete_volume" :: waited 0.051s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:45 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Volume volume-a6090dd2-ccb9-4220-ac6e-66bd048b0e22 (a6090dd2-ccb9-4220-ac6e-66bd048b0e22): created successfully
Jul 04 00:16:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb52f73a-2384-40af-868d-bbd4a69e8993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:45 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Flow 'volume_create_manager' (f9177a98-1cdb-4c64-b3cb-c3bd0c1d4513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:45 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7abfa7f-9ee8-4e33-8c21-7134df242e0c]: (4, 'raw') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:45 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-230ddc69-911b-460e-ae78-02b21232f4f6 tempest-ProjectReaderTests-95017493 None] Created volume successfully.
Jul 04 00:16:45 devstack sudo[105864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed
Jul 04 00:16:45 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Acquiring lock "cinder-a6090dd2-ccb9-4220-ac6e-66bd048b0e22-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Lock "cinder-a6090dd2-ccb9-4220-ac6e-66bd048b0e22-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Acquiring lock "cinder-quobyte-a6090dd2-ccb9-4220-ac6e-66bd048b0e22" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Lock "cinder-quobyte-a6090dd2-ccb9-4220-ac6e-66bd048b0e22" acquired by "delete_volume" :: waited 0.041s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:46 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed" returned: 0 in 1.077s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:46 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac16fc5-48f3-4747-be81-1d99d2767aef]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a6090dd2-ccb9-4220-ac6e-66bd048b0e22 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:46 devstack sudo[105868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed
Jul 04 00:16:46 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:46 devstack sudo[105869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a6090dd2-ccb9-4220-ac6e-66bd048b0e22
Jul 04 00:16:46 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:47 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed" returned: 1 in 1.122s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed' failed. Not Retrying. {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 04 00:16:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:47 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a6090dd2-ccb9-4220-ac6e-66bd048b0e22" returned: 0 in 1.124s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a6090dd2-ccb9-4220-ac6e-66bd048b0e22 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:47 devstack sudo[105879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed
Jul 04 00:16:47 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:47 devstack sudo[105880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a6090dd2-ccb9-4220-ac6e-66bd048b0e22
Jul 04 00:16:47 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:48 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a6090dd2-ccb9-4220-ac6e-66bd048b0e22" returned: 0 in 0.796s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:48 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Lock "cinder-quobyte-a6090dd2-ccb9-4220-ac6e-66bd048b0e22" released by "delete_volume" :: held 1.992s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-189793b2-a0aa-42b9-934b-3e4733ed21ed" returned: 0 in 0.844s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Lock "cinder-quobyte-189793b2-a0aa-42b9-934b-3e4733ed21ed" released by "delete_volume" :: held 3.130s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Created reservations ['9eaf4b51-28f3-43cb-988d-975a4d4de7f1', '0b48a537-81f7-40d4-8820-37098d95b6cd', '8d4e457e-8ef7-4f48-8494-2622e4254910', 'a634bf1e-6ae2-471e-8aee-65318676de12'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Created reservations ['367c0189-90f3-4728-96a0-7ddce54bfeaf', 'bb4bf330-8531-4570-b08b-2a02e882445e', 'd82c8d3e-d0fe-4f42-a8c2-9d7d5066a682', '02b73136-ebf8-4b56-9b72-3f9bf7a4ca76'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:48 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:48 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:48 devstack sudo[105887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:48 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Flow 'volume_create_manager' (75dd4da5-1d4e-498f-994e-07deb4158122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e88d181-8665-4133-bde7-dbfb86c91e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e88d181-8665-4133-bde7-dbfb86c91e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-86579081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf2902b-5b59-4d6e-ae9f-5af505def66a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e9899c2ab4db090bdb839ae0de7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:49Z,use_quota=True,user_id='32b6ff9036a14433a93d6a698649ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a2dc50-db80-413c-8b80-60bc9ce55e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2a2dc50-db80-413c-8b80-60bc9ce55e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b806077-dcb4-4e4a-8dd8-2057d8273890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b806077-dcb4-4e4a-8dd8-2057d8273890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf2902b-5b59-4d6e-ae9f-5af505def66a', 'volume_name': 'volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d69e38-68b1-4291-907a-2eae18bcd8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d69e38-68b1-4291-907a-2eae18bcd8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52019fde-2e35-4f01-b4ab-ea1147d69a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:48 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume 2cf2902b-5b59-4d6e-ae9f-5af505def66a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a', 'volume_size': 1}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-86579081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf2902b-5b59-4d6e-ae9f-5af505def66a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e9899c2ab4db090bdb839ae0de7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:49Z,use_quota=True,user_id='32b6ff9036a14433a93d6a698649ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:16:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Creating volume 2cf2902b-5b59-4d6e-ae9f-5af505def66a {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:16:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:16:49 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:16:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:49 devstack sudo[105889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a 1073741824
Jul 04 00:16:49 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:49 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.845s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:49 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:49 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Deleted volume successfully.
Jul 04 00:16:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b66a0250-09fb-4854-a71b-e56982c492b9 tempest-ProjectReaderTests-95017493 None] Lock "cinder-a6090dd2-ccb9-4220-ac6e-66bd048b0e22-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:49 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.086s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:49 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:49 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Deleted volume successfully.
Jul 04 00:16:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ea8d088f-7ee3-475e-8558-923c7252b01c tempest-VolumeImageDependencyTests-221989484 None] Lock "cinder-189793b2-a0aa-42b9-934b-3e4733ed21ed-delete_volume" released by "delete_volume" :: held 4.715s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:50 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Flow 'volume_create_manager' (1d8c6ef6-688c-4688-8f29-5fb6c5d9d4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:50 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33321df9-e3cf-4744-a673-a1f64ece84e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a 1073741824" returned: 0 in 1.344s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33321df9-e3cf-4744-a673-a1f64ece84e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1398882632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84aad1ac-ef53-42d7-8d68-833b523e8a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841bae223719475fb77da67fc2699ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:50Z,use_quota=True,user_id='215244158ed747a1a49c5037fbb69472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0966e86-18a6-4649-a3ff-d61c1f789271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0966e86-18a6-4649-a3ff-d61c1f789271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d1fc16-e3b0-42d3-8a00-385b731c3ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d1fc16-e3b0-42d3-8a00-385b731c3ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84aad1ac-ef53-42d7-8d68-833b523e8a2c', 'volume_name': 'volume-84aad1ac-ef53-42d7-8d68-833b523e8a2c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7857702d-dd50-41c1-a7eb-395d8db9d143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7857702d-dd50-41c1-a7eb-395d8db9d143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15e6ec0-08fc-4841-8ca1-5bbc7280abc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:50 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Volume 84aad1ac-ef53-42d7-8d68-833b523e8a2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84aad1ac-ef53-42d7-8d68-833b523e8a2c', 'volume_size': 1}
Jul 04 00:16:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:50 devstack sudo[105899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a
Jul 04 00:16:50 devstack sudo[105899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:51 devstack sudo[105899]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a" returned: 0 in 0.854s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] <== create_volume: return (2297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.302s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.891s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1398882632',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84aad1ac-ef53-42d7-8d68-833b523e8a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='841bae223719475fb77da67fc2699ba3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:50Z,use_quota=True,user_id='215244158ed747a1a49c5037fbb69472',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Creating volume 84aad1ac-ef53-42d7-8d68-833b523e8a2c {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:16:51 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-84aad1ac-ef53-42d7-8d68-833b523e8a2c 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:51 devstack sudo[105902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-84aad1ac-ef53-42d7-8d68-833b523e8a2c 1073741824
Jul 04 00:16:51 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52019fde-2e35-4f01-b4ab-ea1147d69a55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c638db-7514-46e1-a0ce-5368671e6972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:51 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a (2cf2902b-5b59-4d6e-ae9f-5af505def66a): created successfully
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c638db-7514-46e1-a0ce-5368671e6972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Flow 'volume_create_manager' (75dd4da5-1d4e-498f-994e-07deb4158122) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:51 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-5bc3f1a5-4194-46b6-abd5-b2bb013593b4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Created volume successfully.
Jul 04 00:16:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:52 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-84aad1ac-ef53-42d7-8d68-833b523e8a2c 1073741824" returned: 0 in 1.052s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-84aad1ac-ef53-42d7-8d68-833b523e8a2c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:52 devstack sudo[105908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-84aad1ac-ef53-42d7-8d68-833b523e8a2c
Jul 04 00:16:52 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:52 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Flow 'volume_create_manager' (3c820755-87e4-4b88-8186-df68f491b952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e263a331-176b-4c30-8549-7e94136c65b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e263a331-176b-4c30-8549-7e94136c65b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1553141211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0a14e0-ceba-4c92-84d3-7a1778a1789b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a7098cd5f7436cb3e46e528ccc0ec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:53Z,use_quota=True,user_id='1910d42a33b84d14855d87eeb3129313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b5ae78-d83a-4070-a2e1-6a6a70685e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b5ae78-d83a-4070-a2e1-6a6a70685e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbf4d2f-46e8-4072-b7dc-2c03d74f6f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbf4d2f-46e8-4072-b7dc-2c03d74f6f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0a14e0-ceba-4c92-84d3-7a1778a1789b', 'volume_name': 'volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a4e95e-6974-49b2-8885-89d8482f64b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a4e95e-6974-49b2-8885-89d8482f64b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5ec1ba-2548-4713-853a-6d535efa21e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:52 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Volume 3e0a14e0-ceba-4c92-84d3-7a1778a1789b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b', 'volume_size': 1}
Jul 04 00:16:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Flow 'volume_create_manager' (44691187-f010-4299-8ab2-018a5fde21c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ef5925-66b3-46b1-a4d6-c8fcc25d296c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ef5925-66b3-46b1-a4d6-c8fcc25d296c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a1ac6a-090b-404e-bb3e-f106f9a947c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b5ea85dbff424bb3cf1bd1d85f7cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:53Z,use_quota=True,user_id='b89384e47cea4e5f9937a373c58c94d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a112e51-7e3c-414d-99ce-177145b6624b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a112e51-7e3c-414d-99ce-177145b6624b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c2c713-cdbe-4d45-acee-6b98c78f3609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c2c713-cdbe-4d45-acee-6b98c78f3609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75a1ac6a-090b-404e-bb3e-f106f9a947c2', 'volume_name': 'volume-75a1ac6a-090b-404e-bb3e-f106f9a947c2', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567a191c-a5c2-4dec-94e1-d4d196c0c013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567a191c-a5c2-4dec-94e1-d4d196c0c013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17743bda-7ddf-4060-84f2-a6f854d99120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:53 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Volume 75a1ac6a-090b-404e-bb3e-f106f9a947c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75a1ac6a-090b-404e-bb3e-f106f9a947c2', 'volume_size': 1}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:53 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-84aad1ac-ef53-42d7-8d68-833b523e8a2c" returned: 0 in 0.771s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Creating offline snapshot 96726228-c4b2-4adb-9e19-2f579f5db771 of volume 2cf2902b-5b59-4d6e-ae9f-5af505def66a {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15e6ec0-08fc-4841-8ca1-5bbc7280abc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84aad1ac-ef53-42d7-8d68-833b523e8a2c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b815d8-7e42-4303-9c9e-4dd33b0c0cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a3d594-0108-406d-a40e-71ecabb3fdac]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:53 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Volume volume-84aad1ac-ef53-42d7-8d68-833b523e8a2c (84aad1ac-ef53-42d7-8d68-833b523e8a2c): created successfully
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7b815d8-7e42-4303-9c9e-4dd33b0c0cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Flow 'volume_create_manager' (1d8c6ef6-688c-4688-8f29-5fb6c5d9d4fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:53 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9721d0d2-8239-423d-86a1-dc35183ebc63 tempest-ProjectReaderTests-95017493 None] Created volume successfully.
Jul 04 00:16:53 devstack sudo[105911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a
Jul 04 00:16:53 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Acquiring lock "cinder-84aad1ac-ef53-42d7-8d68-833b523e8a2c-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Lock "cinder-84aad1ac-ef53-42d7-8d68-833b523e8a2c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Acquiring lock "cinder-quobyte-84aad1ac-ef53-42d7-8d68-833b523e8a2c" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Lock "cinder-quobyte-84aad1ac-ef53-42d7-8d68-833b523e8a2c" acquired by "delete_volume" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[de13edac-86d0-457d-9f7c-3de2d45e5ce0]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:16:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-84aad1ac-ef53-42d7-8d68-833b523e8a2c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:54 devstack sudo[105915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-84aad1ac-ef53-42d7-8d68-833b523e8a2c
Jul 04 00:16:54 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:54 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a" returned: 0 in 0.848s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:54 devstack sudo[105918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771 1G
Jul 04 00:16:54 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:54 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-84aad1ac-ef53-42d7-8d68-833b523e8a2c" returned: 0 in 0.761s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-84aad1ac-ef53-42d7-8d68-833b523e8a2c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:54 devstack sudo[105927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-84aad1ac-ef53-42d7-8d68-833b523e8a2c
Jul 04 00:16:54 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:54 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771 1G" returned: 0 in 0.786s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:54 devstack sudo[105930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771
Jul 04 00:16:54 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:55 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-84aad1ac-ef53-42d7-8d68-833b523e8a2c" returned: 0 in 0.650s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:55 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Lock "cinder-quobyte-84aad1ac-ef53-42d7-8d68-833b523e8a2c" released by "delete_volume" :: held 1.463s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:55 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Created reservations ['720e304c-4baa-4455-8cd5-540c94e23228', '2aeef7c3-4616-4108-a6ea-cc4b20f77e99', '8ea9d616-0553-4096-ac2d-11ba61407625', 'cd4c38c0-fa54-4e8e-a4ae-89221db89a4c'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:16:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:55 devstack sudo[105936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:16:55 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:55 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771" returned: 0 in 0.699s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:55 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771 is being set with open permissions: ugo+rw
Jul 04 00:16:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:55 devstack sudo[105938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771
Jul 04 00:16:55 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:56 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.690s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:56 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:16:56 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Deleted volume successfully.
Jul 04 00:16:56 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3f441fcf-8f3f-4611-80ed-f0a0ab36b133 tempest-ProjectReaderTests-95017493 None] Lock "cinder-84aad1ac-ef53-42d7-8d68-833b523e8a2c-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:16:56 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771" returned: 0 in 0.672s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:56 devstack sudo[105942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.info
Jul 04 00:16:56 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:56 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.info" returned: 0 in 0.665s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:56 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.info is being set with open permissions: ugo+rw
Jul 04 00:16:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:56 devstack sudo[105945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.info
Jul 04 00:16:56 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:57 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.info" returned: 0 in 0.794s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.573s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.781s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:57 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1553141211',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0a14e0-ceba-4c92-84d3-7a1778a1789b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a7098cd5f7436cb3e46e528ccc0ec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:53Z,use_quota=True,user_id='1910d42a33b84d14855d87eeb3129313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:16:57 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Creating volume 3e0a14e0-ceba-4c92-84d3-7a1778a1789b {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:16:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:57 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:57 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:57 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:16:57 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:16:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:57 devstack sudo[105982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b 1073741824
Jul 04 00:16:57 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:57 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-1fe5092f-9a65-4413-a3b1-30536c71a2e4 tempest-CreateVolumesFromSnapshotTest-809941923 None] Create snapshot completed successfully
Jul 04 00:16:58 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b 1073741824" returned: 0 in 0.912s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:58 devstack sudo[105995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b
Jul 04 00:16:58 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:58 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Flow 'volume_create_manager' (81183946-9ca2-4be5-8f65-b8a5bcdde02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd154a5-bcee-4058-836d-00a93c884f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd154a5-bcee-4058-836d-00a93c884f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1121875554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d467543-8e71-49f3-a573-f8b7f1e74778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e9899c2ab4db090bdb839ae0de7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:59Z,use_quota=True,user_id='32b6ff9036a14433a93d6a698649ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db7ef99-3f3c-480a-b4c8-a529ae725c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db7ef99-3f3c-480a-b4c8-a529ae725c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7540a6fa-77f8-4f1d-bada-232710fbf1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7540a6fa-77f8-4f1d-bada-232710fbf1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d467543-8e71-49f3-a573-f8b7f1e74778', 'volume_name': 'volume-2d467543-8e71-49f3-a573-f8b7f1e74778', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:58 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0e5799-bde0-4ac3-8386-0b05eae3906e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da0e5799-bde0-4ac3-8386-0b05eae3906e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca52df7e-c090-4acb-bb06-4c0e246bdc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:59 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume 2d467543-8e71-49f3-a573-f8b7f1e74778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d467543-8e71-49f3-a573-f8b7f1e74778', 'volume_size': 1}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Flow 'volume_create_manager' (af609f43-d4b6-45ce-bc8b-aa748fd98060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f9b42f-644d-4010-86e4-066fa4be7d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7f9b42f-644d-4010-86e4-066fa4be7d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1617510215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7df438d-6be3-434c-b2a5-f954bfaa4ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e9899c2ab4db090bdb839ae0de7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:59Z,use_quota=True,user_id='32b6ff9036a14433a93d6a698649ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a92f8e3-9655-4e4f-b65d-d11755171c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a92f8e3-9655-4e4f-b65d-d11755171c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc38df68-0947-43ae-a80a-5e01276df545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc38df68-0947-43ae-a80a-5e01276df545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7df438d-6be3-434c-b2a5-f954bfaa4ce1', 'volume_name': 'volume-a7df438d-6be3-434c-b2a5-f954bfaa4ce1', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019ea9ff-5f74-4037-8c2c-8c20a8b17611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (019ea9ff-5f74-4037-8c2c-8c20a8b17611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39146713-697d-4927-a863-ea4fe431c187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:59 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume a7df438d-6be3-434c-b2a5-f954bfaa4ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7df438d-6be3-434c-b2a5-f954bfaa4ce1', 'volume_size': 1}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:59 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b" returned: 0 in 0.832s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.438s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75a1ac6a-090b-404e-bb3e-f106f9a947c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b5ea85dbff424bb3cf1bd1d85f7cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:53Z,use_quota=True,user_id='b89384e47cea4e5f9937a373c58c94d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Creating volume 75a1ac6a-090b-404e-bb3e-f106f9a947c2 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:16:59 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-75a1ac6a-090b-404e-bb3e-f106f9a947c2 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5ec1ba-2548-4713-853a-6d535efa21e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:59 devstack sudo[105998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-75a1ac6a-090b-404e-bb3e-f106f9a947c2 1073741824
Jul 04 00:16:59 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6bf517-c376-4498-ba99-d2750c489cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:59 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Volume volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b (3e0a14e0-ceba-4c92-84d3-7a1778a1789b): created successfully
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6bf517-c376-4498-ba99-d2750c489cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Flow 'volume_create_manager' (3c820755-87e4-4b88-8186-df68f491b952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:59 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e398fdf8-2489-4ce2-9432-f6d89f0e51f6 tempest-SnapshotDependencyTests-896262748 None] Created volume successfully.
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Flow 'volume_create_manager' (5a8ec23e-409b-4221-95df-cf3e88c92302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d09961-558e-443c-a256-3996b5406bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d09961-558e-443c-a256-3996b5406bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2048648670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72e0f3a-1bb3-4e69-b151-a7574c81361a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e9899c2ab4db090bdb839ae0de7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:00Z,use_quota=True,user_id='32b6ff9036a14433a93d6a698649ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4691eecb-05a8-4bfb-aee5-112b5f240e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4691eecb-05a8-4bfb-aee5-112b5f240e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe69272-4438-42e5-9eab-7e8775ec0a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fe69272-4438-42e5-9eab-7e8775ec0a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b72e0f3a-1bb3-4e69-b151-a7574c81361a', 'volume_name': 'volume-b72e0f3a-1bb3-4e69-b151-a7574c81361a', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde16d6e-2409-4836-a285-58695ba3e91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde16d6e-2409-4836-a285-58695ba3e91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19de1087-b341-4656-bc53-e4a5d47fd4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:16:59 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume b72e0f3a-1bb3-4e69-b151-a7574c81361a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b72e0f3a-1bb3-4e69-b151-a7574c81361a', 'volume_size': 1}
Jul 04 00:16:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Flow 'volume_create_manager' (f6f29bab-5fa1-43f9-b5b7-17678498af81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48940c49-b7ac-4197-a7ef-29371bdbc256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48940c49-b7ac-4197-a7ef-29371bdbc256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1841967955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b961859-eecd-45c0-97af-f40ddbcbfee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e9899c2ab4db090bdb839ae0de7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:00Z,use_quota=True,user_id='32b6ff9036a14433a93d6a698649ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078c4007-9f68-44eb-a442-acb2e7d22fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078c4007-9f68-44eb-a442-acb2e7d22fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f641b720-4e02-42bc-983c-c583e3bd9e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f641b720-4e02-42bc-983c-c583e3bd9e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b961859-eecd-45c0-97af-f40ddbcbfee3', 'volume_name': 'volume-7b961859-eecd-45c0-97af-f40ddbcbfee3', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c38ff0c-1c89-4cd3-8078-8ef390a9dd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c38ff0c-1c89-4cd3-8078-8ef390a9dd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c29411-f884-4ce4-b51a-0a9156c95f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:00 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume 7b961859-eecd-45c0-97af-f40ddbcbfee3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b961859-eecd-45c0-97af-f40ddbcbfee3', 'volume_size': 1}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:00 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-75a1ac6a-090b-404e-bb3e-f106f9a947c2 1073741824" returned: 0 in 1.061s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-75a1ac6a-090b-404e-bb3e-f106f9a947c2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:17:00 devstack sudo[106005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-75a1ac6a-090b-404e-bb3e-f106f9a947c2
Jul 04 00:17:00 devstack sudo[106005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Flow 'volume_create_manager' (1364c49b-3632-4fe0-98a6-1bfd843d80b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6993d32-fe3c-4469-830c-1654e0e9ab18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6993d32-fe3c-4469-830c-1654e0e9ab18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1955732292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0472364e-7259-4074-bdee-b4a25bfc61d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e9899c2ab4db090bdb839ae0de7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:01Z,use_quota=True,user_id='32b6ff9036a14433a93d6a698649ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0460bc-ba92-4d7f-8def-1a1ad16b1135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d0460bc-ba92-4d7f-8def-1a1ad16b1135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae438d4b-1546-4474-9aee-fe7f4bdfc78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae438d4b-1546-4474-9aee-fe7f4bdfc78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0472364e-7259-4074-bdee-b4a25bfc61d7', 'volume_name': 'volume-0472364e-7259-4074-bdee-b4a25bfc61d7', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a012bf-5ce2-4b93-82da-1f50b555d2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a012bf-5ce2-4b93-82da-1f50b555d2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10d2ff7-2851-42a3-a036-d201e1905d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:00 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume 0472364e-7259-4074-bdee-b4a25bfc61d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0472364e-7259-4074-bdee-b4a25bfc61d7', 'volume_size': 1}
Jul 04 00:17:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:01 devstack sudo[106005]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-75a1ac6a-090b-404e-bb3e-f106f9a947c2" returned: 0 in 0.653s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.779s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.340s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1121875554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d467543-8e71-49f3-a573-f8b7f1e74778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e9899c2ab4db090bdb839ae0de7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:59Z,use_quota=True,user_id='32b6ff9036a14433a93d6a698649ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Creating volume 2d467543-8e71-49f3-a573-f8b7f1e74778 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:17:01 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2d467543-8e71-49f3-a573-f8b7f1e74778 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17743bda-7ddf-4060-84f2-a6f854d99120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75a1ac6a-090b-404e-bb3e-f106f9a947c2', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b33e21-12fc-4ae9-92d7-93cc8135e53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:01 devstack sudo[106008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2d467543-8e71-49f3-a573-f8b7f1e74778 1073741824
Jul 04 00:17:01 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:01 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Volume volume-75a1ac6a-090b-404e-bb3e-f106f9a947c2 (75a1ac6a-090b-404e-bb3e-f106f9a947c2): created successfully
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b33e21-12fc-4ae9-92d7-93cc8135e53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:01 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Flow 'volume_create_manager' (44691187-f010-4299-8ab2-018a5fde21c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:01 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-eb68b6e3-0c59-4bf8-9a1c-8c3e2d1a6327 tempest-CinderUnicodeTest-2113084758 None] Created volume successfully.
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Flow 'volume_create_manager' (2017aac3-8d64-4073-9308-45a3e19f67da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685071dc-5fd9-44d0-b8db-c68be7adbb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (685071dc-5fd9-44d0-b8db-c68be7adbb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2124682659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e9eac0-ba21-469c-bc97-de03102d7cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b5ea85dbff424bb3cf1bd1d85f7cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:02Z,use_quota=True,user_id='b89384e47cea4e5f9937a373c58c94d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6c7b0a-7f4e-428f-b4a1-f24e10c87782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6c7b0a-7f4e-428f-b4a1-f24e10c87782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d90edc-10cd-4cf9-80a6-ebac2ff96fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87d90edc-10cd-4cf9-80a6-ebac2ff96fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36e9eac0-ba21-469c-bc97-de03102d7cfc', 'volume_name': 'volume-36e9eac0-ba21-469c-bc97-de03102d7cfc', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e9c50a-4361-49e0-8a87-c1c5561adfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e9c50a-4361-49e0-8a87-c1c5561adfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4076ca5f-c56a-4b0f-9ca1-03cc318dcdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:02 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Volume 36e9eac0-ba21-469c-bc97-de03102d7cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36e9eac0-ba21-469c-bc97-de03102d7cfc', 'volume_size': 1}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:02 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2d467543-8e71-49f3-a573-f8b7f1e74778 1073741824" returned: 0 in 0.930s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2d467543-8e71-49f3-a573-f8b7f1e74778 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:02 devstack sudo[106017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2d467543-8e71-49f3-a573-f8b7f1e74778
Jul 04 00:17:02 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:02 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2d467543-8e71-49f3-a573-f8b7f1e74778" returned: 0 in 0.666s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.616s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1617510215',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7df438d-6be3-434c-b2a5-f954bfaa4ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e9899c2ab4db090bdb839ae0de7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:16:59Z,use_quota=True,user_id='32b6ff9036a14433a93d6a698649ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Creating volume a7df438d-6be3-434c-b2a5-f954bfaa4ce1 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:17:02 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:17:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7df438d-6be3-434c-b2a5-f954bfaa4ce1 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:03 devstack sudo[106020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7df438d-6be3-434c-b2a5-f954bfaa4ce1 1073741824
Jul 04 00:17:03 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca52df7e-c090-4acb-bb06-4c0e246bdc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d467543-8e71-49f3-a573-f8b7f1e74778', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505e2494-c85d-4aff-b880-a4d65fe6d969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:03 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume volume-2d467543-8e71-49f3-a573-f8b7f1e74778 (2d467543-8e71-49f3-a573-f8b7f1e74778): created successfully
Jul 04 00:17:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (505e2494-c85d-4aff-b880-a4d65fe6d969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:03 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Flow 'volume_create_manager' (81183946-9ca2-4be5-8f65-b8a5bcdde02e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:03 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-5b41459a-71fb-409c-9f30-932da44d6289 tempest-CreateVolumesFromSnapshotTest-809941923 None] Created volume successfully.
Jul 04 00:17:03 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7df438d-6be3-434c-b2a5-f954bfaa4ce1 1073741824" returned: 0 in 0.852s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7df438d-6be3-434c-b2a5-f954bfaa4ce1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:03 devstack sudo[106026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7df438d-6be3-434c-b2a5-f954bfaa4ce1
Jul 04 00:17:03 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:04 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7df438d-6be3-434c-b2a5-f954bfaa4ce1" returned: 0 in 0.659s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.655s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2048648670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72e0f3a-1bb3-4e69-b151-a7574c81361a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e9899c2ab4db090bdb839ae0de7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:00Z,use_quota=True,user_id='32b6ff9036a14433a93d6a698649ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Creating volume b72e0f3a-1bb3-4e69-b151-a7574c81361a {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:17:04 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b72e0f3a-1bb3-4e69-b151-a7574c81361a 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39146713-697d-4927-a863-ea4fe431c187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7df438d-6be3-434c-b2a5-f954bfaa4ce1', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:04 devstack sudo[106030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b72e0f3a-1bb3-4e69-b151-a7574c81361a 1073741824
Jul 04 00:17:04 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beacadf2-75a8-4f2f-b388-f6ded4f7cbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:04 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume volume-a7df438d-6be3-434c-b2a5-f954bfaa4ce1 (a7df438d-6be3-434c-b2a5-f954bfaa4ce1): created successfully
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beacadf2-75a8-4f2f-b388-f6ded4f7cbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:04 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Flow 'volume_create_manager' (af609f43-d4b6-45ce-bc8b-aa748fd98060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:04 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e4419fee-ffa9-4972-a637-52268d6b60a7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Created volume successfully.
Jul 04 00:17:05 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b72e0f3a-1bb3-4e69-b151-a7574c81361a 1073741824" returned: 0 in 0.869s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b72e0f3a-1bb3-4e69-b151-a7574c81361a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:05 devstack sudo[106036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b72e0f3a-1bb3-4e69-b151-a7574c81361a
Jul 04 00:17:05 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:06 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b72e0f3a-1bb3-4e69-b151-a7574c81361a" returned: 0 in 0.641s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.820s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1841967955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b961859-eecd-45c0-97af-f40ddbcbfee3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e9899c2ab4db090bdb839ae0de7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:00Z,use_quota=True,user_id='32b6ff9036a14433a93d6a698649ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Creating volume 7b961859-eecd-45c0-97af-f40ddbcbfee3 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:17:06 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b961859-eecd-45c0-97af-f40ddbcbfee3 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19de1087-b341-4656-bc53-e4a5d47fd4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b72e0f3a-1bb3-4e69-b151-a7574c81361a', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380a17ff-3ddf-4c8c-9965-8f7aea7a8700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:06 devstack sudo[106039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b961859-eecd-45c0-97af-f40ddbcbfee3 1073741824
Jul 04 00:17:06 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:06 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume volume-b72e0f3a-1bb3-4e69-b151-a7574c81361a (b72e0f3a-1bb3-4e69-b151-a7574c81361a): created successfully
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380a17ff-3ddf-4c8c-9965-8f7aea7a8700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Flow 'volume_create_manager' (5a8ec23e-409b-4221-95df-cf3e88c92302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:06 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6140cd30-6fad-4976-a06c-220e28e8f613 tempest-CreateVolumesFromSnapshotTest-809941923 None] Created volume successfully.
Jul 04 00:17:06 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b961859-eecd-45c0-97af-f40ddbcbfee3 1073741824" returned: 0 in 0.875s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b961859-eecd-45c0-97af-f40ddbcbfee3 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:07 devstack sudo[106045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b961859-eecd-45c0-97af-f40ddbcbfee3
Jul 04 00:17:07 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:07 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b961859-eecd-45c0-97af-f40ddbcbfee3" returned: 0 in 0.729s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] <== create_volume: return (1642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:17:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.073s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c29411-f884-4ce4-b51a-0a9156c95f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b961859-eecd-45c0-97af-f40ddbcbfee3', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826adf97-8189-4848-8110-aca956ff4ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] Creating offline snapshot bd3770c7-ec0a-446d-87af-4b132da2e393 of volume 3e0a14e0-ceba-4c92-84d3-7a1778a1789b {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:17:07 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume volume-7b961859-eecd-45c0-97af-f40ddbcbfee3 (7b961859-eecd-45c0-97af-f40ddbcbfee3): created successfully
Jul 04 00:17:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826adf97-8189-4848-8110-aca956ff4ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Flow 'volume_create_manager' (f6f29bab-5fa1-43f9-b5b7-17678498af81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:07 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[718b4902-9b84-49df-936c-0441485948a2]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:07 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3896ea57-4789-4335-a083-3584676d403a tempest-CreateVolumesFromSnapshotTest-809941923 None] Created volume successfully.
Jul 04 00:17:07 devstack sudo[106048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b
Jul 04 00:17:07 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:08 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b" returned: 0 in 0.803s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:08 devstack sudo[106053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393 1G
Jul 04 00:17:08 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:09 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393 1G" returned: 0 in 0.865s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:09 devstack sudo[106059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393
Jul 04 00:17:09 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:10 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393" returned: 0 in 0.707s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:10 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393 is being set with open permissions: ugo+rw
Jul 04 00:17:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:10 devstack sudo[106064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393
Jul 04 00:17:10 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:10 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393" returned: 0 in 0.657s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:10 devstack sudo[106067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.info
Jul 04 00:17:10 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:11 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.info" returned: 0 in 0.652s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:11 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.info is being set with open permissions: ugo+rw
Jul 04 00:17:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:11 devstack sudo[106070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.info
Jul 04 00:17:11 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:12 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.info" returned: 0 in 0.650s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.467s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.434s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1955732292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0472364e-7259-4074-bdee-b4a25bfc61d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35e9899c2ab4db090bdb839ae0de7c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:01Z,use_quota=True,user_id='32b6ff9036a14433a93d6a698649ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:17:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Creating volume 0472364e-7259-4074-bdee-b4a25bfc61d7 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:17:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:12 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:17:12 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:17:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0472364e-7259-4074-bdee-b4a25bfc61d7 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:12 devstack sudo[106073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0472364e-7259-4074-bdee-b4a25bfc61d7 1073741824
Jul 04 00:17:12 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:12 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-5f6395dd-f06e-47f7-a482-321cf03c9f42 tempest-SnapshotDependencyTests-896262748 None] Create snapshot completed successfully
Jul 04 00:17:13 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0472364e-7259-4074-bdee-b4a25bfc61d7 1073741824" returned: 0 in 0.819s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0472364e-7259-4074-bdee-b4a25bfc61d7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:13 devstack sudo[106078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0472364e-7259-4074-bdee-b4a25bfc61d7
Jul 04 00:17:13 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Flow 'volume_create_manager' (aa12d15c-59c2-4842-b4fa-07eb0e2bf613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2673bf63-7f9d-4bb1-b430-d9a7b8a872e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2673bf63-7f9d-4bb1-b430-d9a7b8a872e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4cd2f95-9a7f-43bd-b1d3-6ab45a182966,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a7098cd5f7436cb3e46e528ccc0ec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bd3770c7-ec0a-446d-87af-4b132da2e393,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:14Z,use_quota=True,user_id='1910d42a33b84d14855d87eeb3129313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7478619b-da96-4984-98db-ce968420d8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7478619b-da96-4984-98db-ce968420d8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7106cacd-6931-44ad-b264-f449e3dd9eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7106cacd-6931-44ad-b264-f449e3dd9eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e4cd2f95-9a7f-43bd-b1d3-6ab45a182966', 'volume_name': 'volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966', 'volume_size': 1, 'snapshot_id': 'bd3770c7-ec0a-446d-87af-4b132da2e393'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229ead63-e91b-4948-b869-fbec30bb014f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229ead63-e91b-4948-b869-fbec30bb014f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d569bc9-c994-4f3e-85ac-3887d7a75d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:13 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Volume e4cd2f95-9a7f-43bd-b1d3-6ab45a182966: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966', 'volume_size': 1, 'snapshot_id': 'bd3770c7-ec0a-446d-87af-4b132da2e393'}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:13 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0472364e-7259-4074-bdee-b4a25bfc61d7" returned: 0 in 0.772s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.588s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2124682659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36e9eac0-ba21-469c-bc97-de03102d7cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99b5ea85dbff424bb3cf1bd1d85f7cc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:02Z,use_quota=True,user_id='b89384e47cea4e5f9937a373c58c94d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Creating volume 36e9eac0-ba21-469c-bc97-de03102d7cfc {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:17:13 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:13 devstack sudo[106081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc 1073741824
Jul 04 00:17:13 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d10d2ff7-2851-42a3-a036-d201e1905d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0472364e-7259-4074-bdee-b4a25bfc61d7', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc64120-5297-4b7a-9d68-12d1e2f324df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:13 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Volume volume-0472364e-7259-4074-bdee-b4a25bfc61d7 (0472364e-7259-4074-bdee-b4a25bfc61d7): created successfully
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc64120-5297-4b7a-9d68-12d1e2f324df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Flow 'volume_create_manager' (1364c49b-3632-4fe0-98a6-1bfd843d80b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:13 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ef9d36ba-4051-4847-83b5-393dbd3e6af7 tempest-CreateVolumesFromSnapshotTest-809941923 None] Created volume successfully.
Jul 04 00:17:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:17:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:14 devstack sudo[106087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:17:14 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:14 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc 1073741824" returned: 0 in 0.822s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "cinder-0472364e-7259-4074-bdee-b4a25bfc61d7-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-0472364e-7259-4074-bdee-b4a25bfc61d7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:14 devstack sudo[106090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc
Jul 04 00:17:14 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "cinder-quobyte-0472364e-7259-4074-bdee-b4a25bfc61d7" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-quobyte-0472364e-7259-4074-bdee-b4a25bfc61d7" acquired by "delete_volume" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:14 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ae6d32-d2b5-4551-bc8e-30be408f4f55]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0472364e-7259-4074-bdee-b4a25bfc61d7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:14 devstack sudo[106092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0472364e-7259-4074-bdee-b4a25bfc61d7
Jul 04 00:17:14 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:15 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.724s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:17:15 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc" returned: 0 in 0.632s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.589s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "cinder-quobyte-bd3770c7-ec0a-446d-87af-4b132da2e393-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966" by "_create_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4076ca5f-c56a-4b0f-9ca1-03cc318dcdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36e9eac0-ba21-469c-bc97-de03102d7cfc', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b371a5f5-f1ef-455a-ae7f-d07d1cc7104b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-quobyte-bd3770c7-ec0a-446d-87af-4b132da2e393-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Creating volume e4cd2f95-9a7f-43bd-b1d3-6ab45a182966 from snapshot bd3770c7-ec0a-446d-87af-4b132da2e393 {{(pid=86650) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "cinder-quobyte-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966" by "_copy_volume_from_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:15 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Volume volume-36e9eac0-ba21-469c-bc97-de03102d7cfc (36e9eac0-ba21-469c-bc97-de03102d7cfc): created successfully
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b371a5f5-f1ef-455a-ae7f-d07d1cc7104b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Flow 'volume_create_manager' (2017aac3-8d64-4073-9308-45a3e19f67da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-quobyte-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] snapshot: bd3770c7-ec0a-446d-87af-4b132da2e393, volume: e4cd2f95-9a7f-43bd-b1d3-6ab45a182966,  {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 04 00:17:15 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-52a07ec1-244e-4af8-a1d7-56f6f6b4fdb1 tempest-CinderUnicodeTest-2113084758 None] Created volume successfully.
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf383e0-0cea-42b2-b830-a58846d5e0e2]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:15 devstack sudo[106098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393
Jul 04 00:17:15 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:15 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0472364e-7259-4074-bdee-b4a25bfc61d7" returned: 0 in 0.786s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0472364e-7259-4074-bdee-b4a25bfc61d7 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:15 devstack sudo[106101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0472364e-7259-4074-bdee-b4a25bfc61d7
Jul 04 00:17:15 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:16 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393" returned: 0 in 0.830s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] will copy from snapshot at /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Creating direct copy from snapshot {{(pid=86650) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1aaf41-549d-4fdd-bed0-f402345ad134]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:16 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0472364e-7259-4074-bdee-b4a25bfc61d7" returned: 0 in 0.715s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-quobyte-0472364e-7259-4074-bdee-b4a25bfc61d7" released by "delete_volume" :: held 1.558s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Created reservations ['e6eede03-f7ab-41cb-ae0f-fe5473b29fb4', 'b82f7a4c-82dc-49e3-bb45-2d61b2c0c80f', '555d1c21-a41c-46ca-a353-0e6df0e3a103', '38a451db-9fd1-4f12-b3dc-bbd737f9b501'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:16 devstack sudo[106107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b
Jul 04 00:17:16 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:16 devstack sudo[106109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:17:16 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "cinder-7b961859-eecd-45c0-97af-f40ddbcbfee3-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-7b961859-eecd-45c0-97af-f40ddbcbfee3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "cinder-quobyte-7b961859-eecd-45c0-97af-f40ddbcbfee3" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-quobyte-7b961859-eecd-45c0-97af-f40ddbcbfee3" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:17 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[286a1528-e549-4ea9-80bb-abd297e5fa6a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b961859-eecd-45c0-97af-f40ddbcbfee3 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:17 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.661s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:17 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:17 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Deleted volume successfully.
Jul 04 00:17:17 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c99a7342-247e-49ae-95b9-d165618c9193 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-0472364e-7259-4074-bdee-b4a25bfc61d7-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b" returned: 0 in 0.849s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:17 devstack cinder-volume[86650]: DEBUG cinder.utils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Path /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966 not found in is_blk_device check {{(pid=86650) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 04 00:17:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:17 devstack sudo[106115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b961859-eecd-45c0-97af-f40ddbcbfee3
Jul 04 00:17:17 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:17 devstack sudo[106117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966
Jul 04 00:17:17 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:17 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b961859-eecd-45c0-97af-f40ddbcbfee3" returned: 0 in 0.844s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b961859-eecd-45c0-97af-f40ddbcbfee3 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:17 devstack sudo[106126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b961859-eecd-45c0-97af-f40ddbcbfee3
Jul 04 00:17:17 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:19 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b961859-eecd-45c0-97af-f40ddbcbfee3" returned: 0 in 1.565s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-quobyte-7b961859-eecd-45c0-97af-f40ddbcbfee3" released by "delete_volume" :: held 2.474s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:19 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Created reservations ['747c5f17-7c70-4f33-95ea-d15834059e0c', 'ef4834a9-259f-4db7-be96-ec1a007c04ab', 'b45c458f-9131-49b9-9531-4b44e7d37b52', '561690ba-fb7f-4599-9180-70a8b5b631e2'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:20 devstack sudo[106136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:17:20 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "cinder-b72e0f3a-1bb3-4e69-b151-a7574c81361a-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-b72e0f3a-1bb3-4e69-b151-a7574c81361a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "cinder-quobyte-b72e0f3a-1bb3-4e69-b151-a7574c81361a" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-quobyte-b72e0f3a-1bb3-4e69-b151-a7574c81361a" acquired by "delete_volume" :: waited 0.026s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:21 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c825be-63a3-41bc-9707-2cbdde82c3a7]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b72e0f3a-1bb3-4e69-b151-a7574c81361a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:21 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.220s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:21 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:21 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Deleted volume successfully.
Jul 04 00:17:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3b958b8d-7391-45dd-83a2-df025e905879 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-7b961859-eecd-45c0-97af-f40ddbcbfee3-delete_volume" released by "delete_volume" :: held 4.312s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:21 devstack sudo[106139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b72e0f3a-1bb3-4e69-b151-a7574c81361a
Jul 04 00:17:21 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:22 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966" returned: 0 in 5.339s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:22 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[37aeb273-521c-4be6-94c4-69eed6e3634e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:22 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b72e0f3a-1bb3-4e69-b151-a7574c81361a" returned: 0 in 1.523s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b72e0f3a-1bb3-4e69-b151-a7574c81361a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:22 devstack sudo[106145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b72e0f3a-1bb3-4e69-b151-a7574c81361a
Jul 04 00:17:22 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:22 devstack sudo[106144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b
Jul 04 00:17:22 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:23 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b72e0f3a-1bb3-4e69-b151-a7574c81361a" returned: 0 in 0.636s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:23 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-quobyte-b72e0f3a-1bb3-4e69-b151-a7574c81361a" released by "delete_volume" :: held 2.268s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:23 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Created reservations ['a0b5b707-e96b-47c7-98f6-1ed6f8e05ee6', '107551bb-0d7c-4765-8382-5be3afe4d686', '3e53f94d-1f32-4974-96b2-f4ead8bed8f2', '0ceaa5fb-71aa-438a-9d87-0fc79bc447b9'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:23 devstack sudo[106152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:17:23 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:23 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b" returned: 0 in 0.939s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:23 devstack cinder-volume[86650]: DEBUG cinder.image.image_utils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Image conversion details: src /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966 {{(pid=86650) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 04 00:17:23 devstack cinder-volume[86650]: INFO cinder.image.image_utils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Converted 1024.00 MB image at 191.66 MB/s
Jul 04 00:17:23 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966 is being set with open permissions: ugo+rw
Jul 04 00:17:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:23 devstack sudo[106154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966
Jul 04 00:17:23 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:24 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.635s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:24 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Deleted volume successfully.
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d0c3cdbb-b34a-49d8-8850-d1552e4388ef tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-b72e0f3a-1bb3-4e69-b151-a7574c81361a-delete_volume" released by "delete_volume" :: held 3.201s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:24 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966" returned: 0 in 0.711s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-quobyte-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966" released by "_copy_volume_from_snapshot" :: held 8.765s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-quobyte-bd3770c7-ec0a-446d-87af-4b132da2e393-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966" released by "_create_volume_from_snapshot" :: held 8.810s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.851s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.018s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] Creating offline snapshot 87828d08-d3c0-4574-a94c-0d2c10365608 of volume 36e9eac0-ba21-469c-bc97-de03102d7cfc {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[58df3c5f-dd8d-4198-9a3d-83ad0d3176c7]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d569bc9-c994-4f3e-85ac-3887d7a75d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966', 'volume_size': 1, 'snapshot_id': 'bd3770c7-ec0a-446d-87af-4b132da2e393'}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01caaca2-d0f6-4c26-aeaa-e06cb8cd787f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:24 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Volume volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966 (e4cd2f95-9a7f-43bd-b1d3-6ab45a182966): created successfully
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01caaca2-d0f6-4c26-aeaa-e06cb8cd787f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Flow 'volume_create_manager' (aa12d15c-59c2-4842-b4fa-07eb0e2bf613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:24 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e93745f0-bdb1-4635-ba65-98b9c884d893 tempest-SnapshotDependencyTests-896262748 None] Created volume successfully.
Jul 04 00:17:24 devstack sudo[106159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc
Jul 04 00:17:24 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "cinder-a7df438d-6be3-434c-b2a5-f954bfaa4ce1-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-a7df438d-6be3-434c-b2a5-f954bfaa4ce1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "cinder-quobyte-a7df438d-6be3-434c-b2a5-f954bfaa4ce1" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-quobyte-a7df438d-6be3-434c-b2a5-f954bfaa4ce1" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[660787c4-c403-48bd-b4aa-a370446a4513]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7df438d-6be3-434c-b2a5-f954bfaa4ce1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:24 devstack sudo[106161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7df438d-6be3-434c-b2a5-f954bfaa4ce1
Jul 04 00:17:24 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "cinder-bd3770c7-ec0a-446d-87af-4b132da2e393-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-bd3770c7-ec0a-446d-87af-4b132da2e393-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "cinder-quobyte-3e0a14e0-ceba-4c92-84d3-7a1778a1789b" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-quobyte-3e0a14e0-ceba-4c92-84d3-7a1778a1789b" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "cinder-quobyte-bd3770c7-ec0a-446d-87af-4b132da2e393" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-quobyte-bd3770c7-ec0a-446d-87af-4b132da2e393" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Deleting offline snapshot bd3770c7-ec0a-446d-87af-4b132da2e393 of volume 3e0a14e0-ceba-4c92-84d3-7a1778a1789b {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] snapshot_file for this snap is: volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cef9148-b47e-4291-a0ea-d9a7e528d264]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:24 devstack sudo[106163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393
Jul 04 00:17:24 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:25 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc" returned: 0 in 0.862s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:25 devstack sudo[106168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608 1G
Jul 04 00:17:25 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:25 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7df438d-6be3-434c-b2a5-f954bfaa4ce1" returned: 0 in 0.811s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7df438d-6be3-434c-b2a5-f954bfaa4ce1 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:25 devstack sudo[106173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7df438d-6be3-434c-b2a5-f954bfaa4ce1
Jul 04 00:17:25 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:25 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393" returned: 0 in 0.801s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:25 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:17:25 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3306b3f3-e99b-4181-a4cf-c2d6202dd8ee]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:25 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b
Jul 04 00:17:25 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:26 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:26 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a7df438d-6be3-434c-b2a5-f954bfaa4ce1" returned: 0 in 0.694s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608 1G" returned: 0 in 0.887s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e9eac0-ba21-469c-bc97-de03102d7cfc -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-quobyte-a7df438d-6be3-434c-b2a5-f954bfaa4ce1" released by "delete_volume" :: held 1.565s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:26 devstack sudo[106184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e9eac0-ba21-469c-bc97-de03102d7cfc -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608
Jul 04 00:17:26 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Created reservations ['feac0430-538f-4ace-bb73-073390f87149', '57f68862-ce41-4200-8ac1-b8c48aa32944', 'f8e7e488-161b-4687-91b0-7af12741f97c', '1a0f9f11-9caa-4c34-9528-d020f4851ccf'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:26 devstack sudo[106186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:17:26 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:26 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b" returned: 0 in 0.850s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:26 devstack sudo[106192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393
Jul 04 00:17:26 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "cinder-2d467543-8e71-49f3-a573-f8b7f1e74778-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-2d467543-8e71-49f3-a573-f8b7f1e74778-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "cinder-quobyte-2d467543-8e71-49f3-a573-f8b7f1e74778" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-quobyte-2d467543-8e71-49f3-a573-f8b7f1e74778" acquired by "delete_volume" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22e1dd0-59b3-436d-8a44-5998aac2cf00]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2d467543-8e71-49f3-a573-f8b7f1e74778 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:26 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36e9eac0-ba21-469c-bc97-de03102d7cfc -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608" returned: 0 in 0.856s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:26 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608 is being set with open permissions: ugo+rw
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:26 devstack sudo[106200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608
Jul 04 00:17:26 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:26 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.781s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:26 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:26 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Deleted volume successfully.
Jul 04 00:17:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-edc651c3-ec73-4879-85b1-7a328580bdc6 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-a7df438d-6be3-434c-b2a5-f954bfaa4ce1-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:27 devstack sudo[106199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2d467543-8e71-49f3-a573-f8b7f1e74778
Jul 04 00:17:27 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:27 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393" returned: 0 in 0.931s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:27 devstack sudo[106207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393
Jul 04 00:17:27 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:27 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608" returned: 0 in 0.725s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:27 devstack sudo[106212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.info
Jul 04 00:17:27 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:27 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2d467543-8e71-49f3-a573-f8b7f1e74778" returned: 0 in 0.936s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2d467543-8e71-49f3-a573-f8b7f1e74778 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:27 devstack sudo[106214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2d467543-8e71-49f3-a573-f8b7f1e74778
Jul 04 00:17:27 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:28 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b.bd3770c7-ec0a-446d-87af-4b132da2e393" returned: 0 in 0.753s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-quobyte-bd3770c7-ec0a-446d-87af-4b132da2e393" released by "_delete_snapshot" :: held 3.441s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-quobyte-3e0a14e0-ceba-4c92-84d3-7a1778a1789b" released by "delete_snapshot" :: held 3.470s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:28 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.info" returned: 0 in 0.688s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:28 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.info is being set with open permissions: ugo+rw
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:28 devstack sudo[106218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.info
Jul 04 00:17:28 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Created reservations ['bb67ede0-fbb6-4306-8012-e1cf8b53581a', '9e9d2147-be7e-4a21-b5c0-d557e6039f8a', '43a9a426-3d0a-4364-86a1-0e00711caa8b', '77ddf3f5-f99c-4abe-ab6e-8d75f0648386'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:28 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Delete snapshot completed successfully.
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f34d626f-5b0f-4860-82e7-729b920abe8d tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-bd3770c7-ec0a-446d-87af-4b132da2e393-delete_snapshot" released by "delete_snapshot" :: held 3.661s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:28 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2d467543-8e71-49f3-a573-f8b7f1e74778" returned: 0 in 0.689s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-quobyte-2d467543-8e71-49f3-a573-f8b7f1e74778" released by "delete_volume" :: held 1.691s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Created reservations ['23ebe650-28fa-4860-9fdf-bca307e65bbc', '4208a229-71c9-4b85-8b6c-810669d7a980', 'a9bc3092-19a8-46b0-a581-0d3008bdc105', '0f899575-2b89-4e6d-bad9-78fcf3dbb76e'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:28 devstack sudo[106221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:17:28 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:28 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "cinder-96726228-c4b2-4adb-9e19-2f579f5db771-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:29 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-96726228-c4b2-4adb-9e19-2f579f5db771-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "cinder-quobyte-2cf2902b-5b59-4d6e-ae9f-5af505def66a" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.info" returned: 0 in 0.670s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.798s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-quobyte-2cf2902b-5b59-4d6e-ae9f-5af505def66a" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "cinder-quobyte-96726228-c4b2-4adb-9e19-2f579f5db771" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "cinder-3e0a14e0-ceba-4c92-84d3-7a1778a1789b-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:29 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-728c53da-c12b-4d88-968b-a1b79f57b14c tempest-CinderUnicodeTest-2113084758 None] Create snapshot completed successfully
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-quobyte-96726228-c4b2-4adb-9e19-2f579f5db771" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Deleting offline snapshot 96726228-c4b2-4adb-9e19-2f579f5db771 of volume 2cf2902b-5b59-4d6e-ae9f-5af505def66a {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] snapshot_file for this snap is: volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-3e0a14e0-ceba-4c92-84d3-7a1778a1789b-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d98dda4-137e-48c2-ba22-b935f5be80c0]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "cinder-quobyte-3e0a14e0-ceba-4c92-84d3-7a1778a1789b" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-quobyte-3e0a14e0-ceba-4c92-84d3-7a1778a1789b" acquired by "delete_volume" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed43647f-505a-4f8a-a767-83b3fd37486e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:29 devstack sudo[106224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771
Jul 04 00:17:29 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:29 devstack sudo[106225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b
Jul 04 00:17:29 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:29 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.774s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:29 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Deleted volume successfully.
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-e7438562-8757-4b03-a64f-7acc00393c18 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-2d467543-8e71-49f3-a573-f8b7f1e74778-delete_volume" released by "delete_volume" :: held 2.710s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:29 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771" returned: 0 in 0.828s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cbd37f-281b-4acb-a4bc-ea587480989f]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:30 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b" returned: 0 in 0.823s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Acquiring lock "cinder-87828d08-d3c0-4574-a94c-0d2c10365608-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:30 devstack sudo[106236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b
Jul 04 00:17:30 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Lock "cinder-87828d08-d3c0-4574-a94c-0d2c10365608-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Acquiring lock "cinder-quobyte-36e9eac0-ba21-469c-bc97-de03102d7cfc" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Lock "cinder-quobyte-36e9eac0-ba21-469c-bc97-de03102d7cfc" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Acquiring lock "cinder-quobyte-87828d08-d3c0-4574-a94c-0d2c10365608" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:30 devstack sudo[106235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a
Jul 04 00:17:30 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Lock "cinder-quobyte-87828d08-d3c0-4574-a94c-0d2c10365608" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Deleting offline snapshot 87828d08-d3c0-4574-a94c-0d2c10365608 of volume 36e9eac0-ba21-469c-bc97-de03102d7cfc {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] snapshot_file for this snap is: volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7e6df7-d13a-46e3-bd6e-e5ed75f9e269]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:30 devstack sudo[106239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608
Jul 04 00:17:30 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:30 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-3e0a14e0-ceba-4c92-84d3-7a1778a1789b" returned: 0 in 0.761s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:30 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-quobyte-3e0a14e0-ceba-4c92-84d3-7a1778a1789b" released by "delete_volume" :: held 1.647s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a" returned: 0 in 0.825s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:30 devstack sudo[106245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771
Jul 04 00:17:30 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:30 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Created reservations ['3bf9b1eb-2839-4423-88a5-b86728477e31', '33f61783-67b2-4fb6-8e42-e5c4cae19f78', '314f3ab0-797c-46e4-83ec-2d6354fa75d8', 'e106bf33-b7fe-4cbb-a495-ae189ae81a6a'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:31 devstack sudo[106250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:17:31 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:31 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608" returned: 0 in 0.815s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36e9eac0-ba21-469c-bc97-de03102d7cfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9e366d-18a6-4e0b-a428-3f667aa185d1]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:31 devstack sudo[106252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc
Jul 04 00:17:31 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "cinder-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "cinder-quobyte-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-quobyte-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966" acquired by "delete_volume" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee087722-c635-48da-80b8-3c40740d9666]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:31 devstack sudo[106257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966
Jul 04 00:17:31 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:31 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771" returned: 0 in 0.860s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:31 devstack sudo[106260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771
Jul 04 00:17:31 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:31 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.767s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:31 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Deleted volume successfully.
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-829aaa9c-fa79-4361-a51a-2e92a521432f tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-3e0a14e0-ceba-4c92-84d3-7a1778a1789b-delete_volume" released by "delete_volume" :: held 2.679s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:31 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc" returned: 0 in 0.899s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:32 devstack sudo[106266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608
Jul 04 00:17:32 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:32 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966" returned: 0 in 0.898s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:32 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a.96726228-c4b2-4adb-9e19-2f579f5db771" returned: 0 in 0.705s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:32 devstack sudo[106272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966
Jul 04 00:17:32 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-quobyte-96726228-c4b2-4adb-9e19-2f579f5db771" released by "_delete_snapshot" :: held 3.390s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-quobyte-2cf2902b-5b59-4d6e-ae9f-5af505def66a" released by "delete_snapshot" :: held 3.438s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:32 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Created reservations ['f09ecfd8-4ddf-4c90-9d4f-dccb896e3a40', '2cad842e-e31f-4062-a518-5743995998bb', '6235709e-07a4-4c52-ab02-1a7211f3f666', 'c315c542-cdbe-417b-8a00-440488300d8a'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:32 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Delete snapshot completed successfully.
Jul 04 00:17:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df252759-7ef7-4c71-8b44-406c31ed1c46 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-96726228-c4b2-4adb-9e19-2f579f5db771-delete_snapshot" released by "delete_snapshot" :: held 3.644s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:32 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608" returned: 0 in 0.812s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:32 devstack sudo[106277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608
Jul 04 00:17:32 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:33 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966" returned: 0 in 0.718s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-quobyte-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966" released by "delete_volume" :: held 1.670s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:INSERT=42,cinder:UPDATE=177,cinder:SELECT=128,cinder:DELETE=16 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Created reservations ['8b946f2c-1c76-4b79-a341-1d9e7e1dbfc6', '2ecd2454-0d40-42ef-a136-15cfbe77079a', '8ad4c37c-cc8f-47eb-a427-76eced313c6d', '81733001-4dcb-4357-bec1-cda0a0e9f89b'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "cinder-2cf2902b-5b59-4d6e-ae9f-5af505def66a-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-2cf2902b-5b59-4d6e-ae9f-5af505def66a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "cinder-quobyte-2cf2902b-5b59-4d6e-ae9f-5af505def66a" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:33 devstack sudo[106280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:17:33 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-quobyte-2cf2902b-5b59-4d6e-ae9f-5af505def66a" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b63404-da5e-4be8-81dc-67392ed5d91d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:33 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc.87828d08-d3c0-4574-a94c-0d2c10365608" returned: 0 in 0.670s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Lock "cinder-quobyte-87828d08-d3c0-4574-a94c-0d2c10365608" released by "_delete_snapshot" :: held 3.327s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Lock "cinder-quobyte-36e9eac0-ba21-469c-bc97-de03102d7cfc" released by "delete_snapshot" :: held 3.357s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:33 devstack sudo[106283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a
Jul 04 00:17:33 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Created reservations ['b1bc7beb-41cd-48f5-9af9-039c23137a88', 'a949da27-2a9b-49a3-b207-4d26b44dfc46', '712ad055-352e-488e-b1bb-e3770f80b305', '698a9b4b-bbd3-410a-a73d-104c66086245'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:33 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Delete snapshot completed successfully.
Jul 04 00:17:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15460bcf-7ad1-4fbd-9743-0176dcc3f895 tempest-CinderUnicodeTest-2113084758 None] Lock "cinder-87828d08-d3c0-4574-a94c-0d2c10365608-delete_snapshot" released by "delete_snapshot" :: held 3.576s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:34 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.718s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:34 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:34 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Deleted volume successfully.
Jul 04 00:17:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-7065c4dc-216d-4c73-a233-c88f39dbcdf2 tempest-SnapshotDependencyTests-896262748 None] Lock "cinder-e4cd2f95-9a7f-43bd-b1d3-6ab45a182966-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:34 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a" returned: 0 in 0.852s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:34 devstack sudo[106290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a
Jul 04 00:17:34 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Acquiring lock "cinder-36e9eac0-ba21-469c-bc97-de03102d7cfc-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Lock "cinder-36e9eac0-ba21-469c-bc97-de03102d7cfc-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:34 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:INSERT=55,cinder:UPDATE=182,cinder:SELECT=136,cinder:DELETE=16 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:17:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Acquiring lock "cinder-quobyte-36e9eac0-ba21-469c-bc97-de03102d7cfc" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Lock "cinder-quobyte-36e9eac0-ba21-469c-bc97-de03102d7cfc" acquired by "delete_volume" :: waited 0.030s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:34 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2d5201-ef98-4715-913b-9cca2768757c]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:34 devstack sudo[106293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc
Jul 04 00:17:34 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:35 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-2cf2902b-5b59-4d6e-ae9f-5af505def66a" returned: 0 in 0.818s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-quobyte-2cf2902b-5b59-4d6e-ae9f-5af505def66a" released by "delete_volume" :: held 1.736s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:35 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Created reservations ['399ca193-f152-4dea-b49b-557d1e195171', '9a1dd2f0-0573-4c00-8eb9-51d865570fa5', '675962c4-cc8a-4d6b-a4e8-d89e471aef2a', '75262339-6cd9-43d5-a918-44f9ed39ebd5'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:35 devstack sudo[106296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:17:35 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:35 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc" returned: 0 in 0.867s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:35 devstack sudo[106303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc
Jul 04 00:17:35 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:36 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.838s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:36 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:36 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Deleted volume successfully.
Jul 04 00:17:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d954e9b-d6e4-4b7b-a531-932e2bac2c82 tempest-CreateVolumesFromSnapshotTest-809941923 None] Lock "cinder-2cf2902b-5b59-4d6e-ae9f-5af505def66a-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-36e9eac0-ba21-469c-bc97-de03102d7cfc" returned: 0 in 0.832s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:36 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Lock "cinder-quobyte-36e9eac0-ba21-469c-bc97-de03102d7cfc" released by "delete_volume" :: held 1.812s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:36 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Created reservations ['70faf3f5-f520-4895-b728-4a5adf496ee9', '2ad9d5a6-ee92-46ab-8fa6-72d602861fbb', 'cf9782c9-e5ca-44f9-8e25-a64036017d35', 'fa7a61d2-a30c-4280-8e3c-97a9ab421f8c'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:36 devstack sudo[106307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:17:36 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Acquiring lock "cinder-75a1ac6a-090b-404e-bb3e-f106f9a947c2-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Lock "cinder-75a1ac6a-090b-404e-bb3e-f106f9a947c2-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Acquiring lock "cinder-quobyte-75a1ac6a-090b-404e-bb3e-f106f9a947c2" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Lock "cinder-quobyte-75a1ac6a-090b-404e-bb3e-f106f9a947c2" acquired by "delete_volume" :: waited 0.037s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:37 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1edaf6-3d65-49b9-8937-c520069be627]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-75a1ac6a-090b-404e-bb3e-f106f9a947c2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:37 devstack sudo[106309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-75a1ac6a-090b-404e-bb3e-f106f9a947c2
Jul 04 00:17:37 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:37 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 1.021s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:37 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:37 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Deleted volume successfully.
Jul 04 00:17:37 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-750ae57d-9c59-483a-9ff0-61a3e07f41dc tempest-CinderUnicodeTest-2113084758 None] Lock "cinder-36e9eac0-ba21-469c-bc97-de03102d7cfc-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:38 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-75a1ac6a-090b-404e-bb3e-f106f9a947c2" returned: 0 in 1.102s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-75a1ac6a-090b-404e-bb3e-f106f9a947c2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:38 devstack sudo[106318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-75a1ac6a-090b-404e-bb3e-f106f9a947c2
Jul 04 00:17:38 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:39 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-75a1ac6a-090b-404e-bb3e-f106f9a947c2" returned: 0 in 0.807s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Lock "cinder-quobyte-75a1ac6a-090b-404e-bb3e-f106f9a947c2" released by "delete_volume" :: held 1.970s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:39 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Created reservations ['c15211c4-064a-451c-804d-7947748876dd', '6896e2c2-a8e1-4c95-8bcf-a0f85b16b8b6', 'cb703a76-b4e0-47b3-9143-9d1a471bcd2a', '8d01cbbb-a4dd-4eda-b099-a4f58aaae273'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:17:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:39 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:39 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:39 devstack sudo[106321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:17:39 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:39 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.760s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:39 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:17:39 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Deleted volume successfully.
Jul 04 00:17:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-0eb78889-8279-4ffc-a3ce-f7844b99b8a3 tempest-CinderUnicodeTest-2113084758 None] Lock "cinder-75a1ac6a-090b-404e-bb3e-f106f9a947c2-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:17:40 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f3b16947-a438-4efc-9ccb-fc5da4394fb9 tempest-ProjectAdminTests-780133602 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577629089355, 'free_capacity_gb': 1775.7577629089355, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86650) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 04 00:17:49 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=37,cinder:SELECT=17,cinder:INSERT=9,cinder:DELETE=2 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:17:49 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=16,cinder:INSERT=4,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (ba31700a-4a09-4b45-8ed1-46bb142a9498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46d80d87-17cd-42e1-a90f-b53a9a46ba90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46d80d87-17cd-42e1-a90f-b53a9a46ba90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1973585421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8030974b-2955-48fc-9a55-aaa88d117cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:51Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c592ad9-b976-45ad-adb5-f0fc7c756b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c592ad9-b976-45ad-adb5-f0fc7c756b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37f1cc3-2c1c-4d08-b61e-251eb1b073a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d37f1cc3-2c1c-4d08-b61e-251eb1b073a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8030974b-2955-48fc-9a55-aaa88d117cb2', 'volume_name': 'volume-8030974b-2955-48fc-9a55-aaa88d117cb2', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3cd759-0cd7-4513-9d50-d4c3e4e5237d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3cd759-0cd7-4513-9d50-d4c3e4e5237d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c0cd30-f2b9-4d88-be30-9645ecbd410b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:51 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Volume 8030974b-2955-48fc-9a55-aaa88d117cb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8030974b-2955-48fc-9a55-aaa88d117cb2', 'volume_size': 1}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1973585421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8030974b-2955-48fc-9a55-aaa88d117cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:51Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Creating volume 8030974b-2955-48fc-9a55-aaa88d117cb2 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:17:51 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:51 devstack sudo[106328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2 1073741824
Jul 04 00:17:51 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Flow 'volume_create_manager' (4c8d6d59-b326-4dd9-ba45-95f570872ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07b0300-952b-4a8d-813f-0c9057487829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a07b0300-952b-4a8d-813f-0c9057487829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-901432532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f98174e-09ac-452d-b86f-416075624f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6d57aafba14c318bdb44162335bf67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:51Z,use_quota=True,user_id='1f14796bdcbd49d6a4b064ed1d4ddc57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8796df12-4e43-4d75-8ec4-ac006dbe406f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8796df12-4e43-4d75-8ec4-ac006dbe406f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b639457-a90a-48f6-a40a-3b1b28b95412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b639457-a90a-48f6-a40a-3b1b28b95412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f98174e-09ac-452d-b86f-416075624f50', 'volume_name': 'volume-0f98174e-09ac-452d-b86f-416075624f50', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f43f028-8792-4531-ade6-bfd87ed358b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f43f028-8792-4531-ade6-bfd87ed358b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8d409f-d2a5-42f8-b5f8-eca864565ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:51 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Volume 0f98174e-09ac-452d-b86f-416075624f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f98174e-09ac-452d-b86f-416075624f50', 'volume_size': 1}
Jul 04 00:17:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:52 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2 1073741824" returned: 0 in 0.837s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:52 devstack sudo[106334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2
Jul 04 00:17:52 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:52 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2" returned: 0 in 0.652s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.389s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-901432532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f98174e-09ac-452d-b86f-416075624f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6d57aafba14c318bdb44162335bf67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:17:51Z,use_quota=True,user_id='1f14796bdcbd49d6a4b064ed1d4ddc57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Creating volume 0f98174e-09ac-452d-b86f-416075624f50 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:17:52 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:52 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50 1073741824
Jul 04 00:17:52 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5c0cd30-f2b9-4d88-be30-9645ecbd410b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8030974b-2955-48fc-9a55-aaa88d117cb2', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e38f408-cf31-4899-8b57-c8c0fd518ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:52 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Volume volume-8030974b-2955-48fc-9a55-aaa88d117cb2 (8030974b-2955-48fc-9a55-aaa88d117cb2): created successfully
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e38f408-cf31-4899-8b57-c8c0fd518ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (ba31700a-4a09-4b45-8ed1-46bb142a9498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:52 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-a8e4c68f-345a-4410-a7bb-6de5a526cf93 tempest-ProjectMemberTests-136049202 None] Created volume successfully.
Jul 04 00:17:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:53 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50 1073741824" returned: 0 in 0.838s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:53 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50
Jul 04 00:17:53 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:54 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50" returned: 0 in 0.666s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:17:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.738s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a8d409f-d2a5-42f8-b5f8-eca864565ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f98174e-09ac-452d-b86f-416075624f50', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd32a7d-23ef-45a7-8a71-1168f75ef450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:17:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] Creating offline snapshot e475a121-9e31-4973-925d-f99d6e50f0b4 of volume 8030974b-2955-48fc-9a55-aaa88d117cb2 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:17:54 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Volume volume-0f98174e-09ac-452d-b86f-416075624f50 (0f98174e-09ac-452d-b86f-416075624f50): created successfully
Jul 04 00:17:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd32a7d-23ef-45a7-8a71-1168f75ef450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:17:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Flow 'volume_create_manager' (4c8d6d59-b326-4dd9-ba45-95f570872ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:17:54 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2e5526-0b0a-4b1e-8852-dc61660adf6d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:54 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3b984a51-a547-4fc3-83f7-43a9233a74c9 tempest-ProjectReaderTests-1508998797 None] Created volume successfully.
Jul 04 00:17:54 devstack sudo[106347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2
Jul 04 00:17:54 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:55 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2" returned: 0 in 0.806s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:55 devstack sudo[106352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4 1G
Jul 04 00:17:55 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:17:56 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4 1G" returned: 0 in 0.826s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8030974b-2955-48fc-9a55-aaa88d117cb2 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:56 devstack sudo[106357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8030974b-2955-48fc-9a55-aaa88d117cb2 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4
Jul 04 00:17:56 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:56 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8030974b-2955-48fc-9a55-aaa88d117cb2 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4" returned: 0 in 0.755s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:56 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4 is being set with open permissions: ugo+rw
Jul 04 00:17:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:56 devstack sudo[106362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4
Jul 04 00:17:56 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:57 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4" returned: 0 in 0.713s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:57 devstack sudo[106365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.info
Jul 04 00:17:57 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:58 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.info" returned: 0 in 0.661s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:58 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.info is being set with open permissions: ugo+rw
Jul 04 00:17:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:58 devstack sudo[106408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.info
Jul 04 00:17:58 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:58 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.info" returned: 0 in 0.650s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.535s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:17:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.080s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:17:58 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] Creating offline snapshot 947f2e3b-667e-450a-8b44-b09cef2e0bf3 of volume 0f98174e-09ac-452d-b86f-416075624f50 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:17:58 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-a05dc57d-efed-4f51-ad1e-ae11d0dc4bd1 tempest-ProjectMemberTests-136049202 None] Create snapshot completed successfully
Jul 04 00:17:58 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ba44df-d17f-4d8a-9445-280d601de047]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:59 devstack sudo[106413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50
Jul 04 00:17:59 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:59 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root
Jul 04 00:17:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50" returned: 0 in 0.740s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:17:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:17:59 devstack sudo[106418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3 1G
Jul 04 00:17:59 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:17:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-e475a121-9e31-4973-925d-f99d6e50f0b4-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Lock "cinder-e475a121-9e31-4973-925d-f99d6e50f0b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-8030974b-2955-48fc-9a55-aaa88d117cb2" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-8030974b-2955-48fc-9a55-aaa88d117cb2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-e475a121-9e31-4973-925d-f99d6e50f0b4" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:17:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-e475a121-9e31-4973-925d-f99d6e50f0b4" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:17:59 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Deleting offline snapshot e475a121-9e31-4973-925d-f99d6e50f0b4 of volume 8030974b-2955-48fc-9a55-aaa88d117cb2 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:17:59 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] snapshot_file for this snap is: volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:17:59 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[64775a1f-a190-42f3-aa5c-9d0f5b52f76a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:17:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:00 devstack sudo[106420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4
Jul 04 00:18:00 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:00 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3 1G" returned: 0 in 0.826s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f98174e-09ac-452d-b86f-416075624f50 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:00 devstack sudo[106425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f98174e-09ac-452d-b86f-416075624f50 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3
Jul 04 00:18:00 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:00 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4" returned: 0 in 0.852s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8030974b-2955-48fc-9a55-aaa88d117cb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:18:00 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df7f1f9-17bc-49b8-980a-d503f7a313be]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:00 devstack sudo[106430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2
Jul 04 00:18:00 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:01 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f98174e-09ac-452d-b86f-416075624f50 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3" returned: 0 in 0.721s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:01 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3 is being set with open permissions: ugo+rw
Jul 04 00:18:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:01 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3
Jul 04 00:18:01 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:01 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2" returned: 0 in 0.844s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:01 devstack sudo[106440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4
Jul 04 00:18:01 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:01 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3" returned: 0 in 0.654s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:01 devstack sudo[106443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.info
Jul 04 00:18:01 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:02 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4" returned: 0 in 0.839s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:02 devstack sudo[106449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4
Jul 04 00:18:02 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:02 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.info" returned: 0 in 0.728s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:02 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.info is being set with open permissions: ugo+rw
Jul 04 00:18:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:02 devstack sudo[106451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.info
Jul 04 00:18:02 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:03 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2.e475a121-9e31-4973-925d-f99d6e50f0b4" returned: 0 in 0.748s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-e475a121-9e31-4973-925d-f99d6e50f0b4" released by "_delete_snapshot" :: held 3.423s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-8030974b-2955-48fc-9a55-aaa88d117cb2" released by "delete_snapshot" :: held 3.455s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:03 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.info" returned: 0 in 0.798s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.561s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:03 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Created reservations ['dd47db9f-5bf0-48f5-a62b-5031e7d730bc', '80432474-b2e8-4ff7-a871-15fc5e2c6389', '6e4b7a94-01e7-452c-9b32-85f3080085bb', '1222bb49-11f8-429c-9693-360ca3a36182'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:03 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-d8184524-98bf-4317-a870-e7409af78d08 tempest-ProjectReaderTests-1508998797 None] Create snapshot completed successfully
Jul 04 00:18:03 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Delete snapshot completed successfully.
Jul 04 00:18:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-b0d30c10-622c-4dc1-9674-772000d21623 tempest-ProjectMemberTests-136049202 None] Lock "cinder-e475a121-9e31-4973-925d-f99d6e50f0b4-delete_snapshot" released by "delete_snapshot" :: held 3.658s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-8030974b-2955-48fc-9a55-aaa88d117cb2-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Lock "cinder-8030974b-2955-48fc-9a55-aaa88d117cb2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-8030974b-2955-48fc-9a55-aaa88d117cb2" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-8030974b-2955-48fc-9a55-aaa88d117cb2" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:04 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f241a5-6c9a-4887-896f-ef5d019b001a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-947f2e3b-667e-450a-8b44-b09cef2e0bf3-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-947f2e3b-667e-450a-8b44-b09cef2e0bf3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-quobyte-0f98174e-09ac-452d-b86f-416075624f50" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:04 devstack sudo[106456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2
Jul 04 00:18:04 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-0f98174e-09ac-452d-b86f-416075624f50" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-quobyte-947f2e3b-667e-450a-8b44-b09cef2e0bf3" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-947f2e3b-667e-450a-8b44-b09cef2e0bf3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Deleting offline snapshot 947f2e3b-667e-450a-8b44-b09cef2e0bf3 of volume 0f98174e-09ac-452d-b86f-416075624f50 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:18:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] snapshot_file for this snap is: volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:18:04 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b96ff5-8e72-45bd-84c9-f0af50dca11a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:04 devstack sudo[106458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3
Jul 04 00:18:04 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:05 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2" returned: 0 in 0.846s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:05 devstack sudo[106463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2
Jul 04 00:18:05 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:05 devstack sudo[106458]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3" returned: 0 in 0.895s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f98174e-09ac-452d-b86f-416075624f50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:18:05 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d485ab1-4694-4902-9213-8cf07f44a7bf]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:05 devstack sudo[106468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50
Jul 04 00:18:05 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:05 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-8030974b-2955-48fc-9a55-aaa88d117cb2" returned: 0 in 0.682s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-8030974b-2955-48fc-9a55-aaa88d117cb2" released by "delete_volume" :: held 1.598s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:05 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Created reservations ['6e9b458a-8d2a-40d2-b215-7659e56a506e', '828e097c-b1e6-48c0-a89b-3d4b45514b83', '6fb65170-6c85-4dfb-b90b-57c716388f45', '02c0216f-b5ca-43de-b4f5-1a25b706585c'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:05 devstack sudo[106471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:18:05 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:06 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50" returned: 0 in 0.836s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:06 devstack sudo[106476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3
Jul 04 00:18:06 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:06 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.767s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:06 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:18:06 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Deleted volume successfully.
Jul 04 00:18:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3028ae54-3c5e-4262-aeab-ebc619634704 tempest-ProjectMemberTests-136049202 None] Lock "cinder-8030974b-2955-48fc-9a55-aaa88d117cb2-delete_volume" released by "delete_volume" :: held 2.609s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:06 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:18:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (cd271a13-4c38-491b-a50f-a9a1ba905ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe14308-891f-4caf-9b91-c900bcce0285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe14308-891f-4caf-9b91-c900bcce0285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842065066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2326911-8cec-4b9a-8e53-686860f9607d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:07Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:06 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7faf93-c20c-45fa-972a-cd49ade5f354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab7faf93-c20c-45fa-972a-cd49ade5f354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee1faec-983d-4756-b69f-3f4cd60d2a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee1faec-983d-4756-b69f-3f4cd60d2a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2326911-8cec-4b9a-8e53-686860f9607d', 'volume_name': 'volume-b2326911-8cec-4b9a-8e53-686860f9607d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f987e0-584b-49d7-af34-939db9cb1168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f987e0-584b-49d7-af34-939db9cb1168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:07 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb3d56c-b0bb-4095-b29f-ffce49b545e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:07 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Volume b2326911-8cec-4b9a-8e53-686860f9607d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2326911-8cec-4b9a-8e53-686860f9607d', 'volume_size': 1}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1842065066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2326911-8cec-4b9a-8e53-686860f9607d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:07Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Creating volume b2326911-8cec-4b9a-8e53-686860f9607d {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:18:07 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3" returned: 0 in 0.883s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:07 devstack sudo[106482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d 1073741824
Jul 04 00:18:07 devstack sudo[106482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:07 devstack sudo[106483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3
Jul 04 00:18:07 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:07 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50.947f2e3b-667e-450a-8b44-b09cef2e0bf3" returned: 0 in 0.708s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-947f2e3b-667e-450a-8b44-b09cef2e0bf3" released by "_delete_snapshot" :: held 3.415s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-0f98174e-09ac-452d-b86f-416075624f50" released by "delete_snapshot" :: held 3.439s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Created reservations ['40172b81-b55d-4133-8b8f-64f94cbc3a39', 'b0f78d87-6cab-44e4-af31-d5258b7a48ca', '231c78d4-321b-4ce4-88ef-c6e59eb3f067', 'a1daf03c-26cd-4e72-9727-897687ff66e5'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:07 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Delete snapshot completed successfully.
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-739cc8be-ced2-47ba-ae0d-eae167b2fdb6 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-947f2e3b-667e-450a-8b44-b09cef2e0bf3-delete_snapshot" released by "delete_snapshot" :: held 3.592s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:07 devstack sudo[106482]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d 1073741824" returned: 0 in 0.899s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:07 devstack sudo[106490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d
Jul 04 00:18:07 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-0f98174e-09ac-452d-b86f-416075624f50-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-0f98174e-09ac-452d-b86f-416075624f50-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:08 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d" returned: 0 in 0.699s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:18:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-quobyte-0f98174e-09ac-452d-b86f-416075624f50" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-0f98174e-09ac-452d-b86f-416075624f50" acquired by "delete_volume" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb3d56c-b0bb-4095-b29f-ffce49b545e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2326911-8cec-4b9a-8e53-686860f9607d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8595b4-3ea4-477e-8ec9-58057f8f5d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:08 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb7b6ae-2bb5-4fd9-9df2-0c56f2ca19e8]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:08 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Volume volume-b2326911-8cec-4b9a-8e53-686860f9607d (b2326911-8cec-4b9a-8e53-686860f9607d): created successfully
Jul 04 00:18:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e8595b4-3ea4-477e-8ec9-58057f8f5d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (cd271a13-4c38-491b-a50f-a9a1ba905ad9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:08 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-80b9c1fa-d3d0-4b7b-a5fa-b3604ddb526f tempest-ProjectMemberTests-136049202 None] Created volume successfully.
Jul 04 00:18:08 devstack sudo[106493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50
Jul 04 00:18:08 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:09 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] Creating offline snapshot e2267106-a43f-43a4-8ad6-92d5a33963ba of volume b2326911-8cec-4b9a-8e53-686860f9607d {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:18:09 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[425793fb-5605-40a1-bd70-147194f7a4b0]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:09 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d
Jul 04 00:18:09 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:09 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50" returned: 0 in 0.849s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:09 devstack sudo[106500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50
Jul 04 00:18:09 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:10 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d" returned: 0 in 0.845s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:10 devstack sudo[106505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba 1G
Jul 04 00:18:10 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:10 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-0f98174e-09ac-452d-b86f-416075624f50" returned: 0 in 0.719s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:10 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-0f98174e-09ac-452d-b86f-416075624f50" released by "delete_volume" :: held 1.642s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:10 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Created reservations ['61371e77-e173-4c4f-b986-7124f9374b42', 'c69b6fd2-0628-4934-81d6-4b9ebd1542a7', '33f90f07-ba09-4522-a952-a0c126bbefc5', '0d5767fb-1c32-4d59-9a22-10bdea8ac0f7'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:10 devstack sudo[106508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:18:10 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:10 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba 1G" returned: 0 in 0.889s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2326911-8cec-4b9a-8e53-686860f9607d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:11 devstack sudo[106514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2326911-8cec-4b9a-8e53-686860f9607d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba
Jul 04 00:18:11 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:11 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.715s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:18:11 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Deleted volume successfully.
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-df98b014-be4a-4376-9e63-f06c2d870843 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-0f98174e-09ac-452d-b86f-416075624f50-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Flow 'volume_create_manager' (be62c249-8be9-4aa0-abdb-f8a1e6621571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ed085a-92fd-4a95-bf32-0b3c6ab8a7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ed085a-92fd-4a95-bf32-0b3c6ab8a7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1566364204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb790e1-c251-4b72-b007-6d62531fce53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6d57aafba14c318bdb44162335bf67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:11Z,use_quota=True,user_id='1f14796bdcbd49d6a4b064ed1d4ddc57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7af927-6f08-4ed1-aa87-32fda590fc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b7af927-6f08-4ed1-aa87-32fda590fc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555c59c8-5646-4a6f-86f1-cba35457580a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (555c59c8-5646-4a6f-86f1-cba35457580a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eb790e1-c251-4b72-b007-6d62531fce53', 'volume_name': 'volume-6eb790e1-c251-4b72-b007-6d62531fce53', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861c94e0-45fe-4da7-863e-93afcfa92ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861c94e0-45fe-4da7-863e-93afcfa92ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f348b46e-090f-4269-9a6b-c9bdcbf23588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:11 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Volume 6eb790e1-c251-4b72-b007-6d62531fce53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eb790e1-c251-4b72-b007-6d62531fce53', 'volume_size': 1}
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:11 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2326911-8cec-4b9a-8e53-686860f9607d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba" returned: 0 in 0.792s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:11 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba is being set with open permissions: ugo+rw
Jul 04 00:18:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:11 devstack sudo[106521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba
Jul 04 00:18:11 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:12 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba" returned: 0 in 0.688s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:12 devstack sudo[106524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.info
Jul 04 00:18:12 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:13 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.info" returned: 0 in 0.662s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:13 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.info is being set with open permissions: ugo+rw
Jul 04 00:18:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:13 devstack sudo[106527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.info
Jul 04 00:18:13 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:13 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.info" returned: 0 in 0.673s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.632s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.337s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1566364204',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb790e1-c251-4b72-b007-6d62531fce53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6d57aafba14c318bdb44162335bf67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:11Z,use_quota=True,user_id='1f14796bdcbd49d6a4b064ed1d4ddc57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:18:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Creating volume 6eb790e1-c251-4b72-b007-6d62531fce53 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:18:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:18:13 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:18:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:13 devstack sudo[106530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53 1073741824
Jul 04 00:18:13 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:13 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-61a6b408-2ab1-4f06-bf31-51357574329e tempest-ProjectMemberTests-136049202 None] Create snapshot completed successfully
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-e2267106-a43f-43a4-8ad6-92d5a33963ba-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Lock "cinder-e2267106-a43f-43a4-8ad6-92d5a33963ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-b2326911-8cec-4b9a-8e53-686860f9607d" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:14 devstack sudo[106535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:18:14 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-b2326911-8cec-4b9a-8e53-686860f9607d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-e2267106-a43f-43a4-8ad6-92d5a33963ba" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-e2267106-a43f-43a4-8ad6-92d5a33963ba" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Deleting offline snapshot e2267106-a43f-43a4-8ad6-92d5a33963ba of volume b2326911-8cec-4b9a-8e53-686860f9607d {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] snapshot_file for this snap is: volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac85de1d-d888-466f-9609-7703d8641bcd]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:14 devstack sudo[106538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba
Jul 04 00:18:14 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:14 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53 1073741824" returned: 0 in 0.968s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:14 devstack sudo[106540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53
Jul 04 00:18:14 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:15 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.771s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:18:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:18:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:18:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:18:15 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba" returned: 0 in 0.868s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2326911-8cec-4b9a-8e53-686860f9607d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:18:15 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86d9d86-bd6d-48bf-bfb4-ffd5c0a55d70]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:15 devstack sudo[106547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d
Jul 04 00:18:15 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:15 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53" returned: 0 in 0.752s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:18:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f348b46e-090f-4269-9a6b-c9bdcbf23588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eb790e1-c251-4b72-b007-6d62531fce53', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fa6497-762c-49ed-b33a-0675dba7455d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:15 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Volume volume-6eb790e1-c251-4b72-b007-6d62531fce53 (6eb790e1-c251-4b72-b007-6d62531fce53): created successfully
Jul 04 00:18:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fa6497-762c-49ed-b33a-0675dba7455d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Flow 'volume_create_manager' (be62c249-8be9-4aa0-abdb-f8a1e6621571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:15 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-91b1b516-0ee4-46e7-9e0d-c1ad86f3507a tempest-ProjectReaderTests-1508998797 None] Created volume successfully.
Jul 04 00:18:16 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d" returned: 0 in 0.804s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:16 devstack sudo[106552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba
Jul 04 00:18:16 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] Creating offline snapshot 64f552f2-d3e3-4f28-8914-d833c9406ecb of volume 6eb790e1-c251-4b72-b007-6d62531fce53 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:18:16 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[37566de6-c12c-4039-ad49-10ff8ec2755e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:17 devstack sudo[106557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53
Jul 04 00:18:17 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:17 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba" returned: 0 in 0.864s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:17 devstack sudo[106559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba
Jul 04 00:18:17 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:17 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53" returned: 0 in 0.865s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:17 devstack sudo[106565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb 1G
Jul 04 00:18:17 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:17 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d.e2267106-a43f-43a4-8ad6-92d5a33963ba" returned: 0 in 0.757s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-e2267106-a43f-43a4-8ad6-92d5a33963ba" released by "_delete_snapshot" :: held 3.406s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-b2326911-8cec-4b9a-8e53-686860f9607d" released by "delete_snapshot" :: held 3.436s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:18 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Created reservations ['b20bab9a-9204-4f8c-8f33-49369147246f', '4ed266c6-9e98-4f6c-940b-4c4650f5126e', 'aaf52783-cdb1-4a4b-8d38-bb1c4eab0bc7', '53c6a142-e6fe-4d29-b668-4f7cfb1b7f07'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:18 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Delete snapshot completed successfully.
Jul 04 00:18:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-95d25efe-9794-4d9c-807d-957036f28ecc tempest-ProjectMemberTests-136049202 None] Lock "cinder-e2267106-a43f-43a4-8ad6-92d5a33963ba-delete_snapshot" released by "delete_snapshot" :: held 3.583s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:18 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb 1G" returned: 0 in 0.839s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb790e1-c251-4b72-b007-6d62531fce53 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:18 devstack sudo[106570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb790e1-c251-4b72-b007-6d62531fce53 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb
Jul 04 00:18:18 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-b2326911-8cec-4b9a-8e53-686860f9607d-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Lock "cinder-b2326911-8cec-4b9a-8e53-686860f9607d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-b2326911-8cec-4b9a-8e53-686860f9607d" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-b2326911-8cec-4b9a-8e53-686860f9607d" acquired by "delete_volume" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:18 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ad0a78-971a-477f-ba8d-5b325413cf75]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:18 devstack sudo[106572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d
Jul 04 00:18:18 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:19 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6eb790e1-c251-4b72-b007-6d62531fce53 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb" returned: 0 in 0.718s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:19 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb is being set with open permissions: ugo+rw
Jul 04 00:18:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:19 devstack sudo[106577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb
Jul 04 00:18:19 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:19 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d" returned: 0 in 0.788s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:19 devstack sudo[106582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d
Jul 04 00:18:19 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:20 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb" returned: 0 in 0.738s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:20 devstack sudo[106585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.info
Jul 04 00:18:20 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:20 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b2326911-8cec-4b9a-8e53-686860f9607d" returned: 0 in 0.653s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-b2326911-8cec-4b9a-8e53-686860f9607d" released by "delete_volume" :: held 1.508s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:20 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Created reservations ['850c3b97-b2c0-4a9f-85d6-d2d2a738e41a', 'fbee2cd0-3bc1-453c-bc39-a1c2befca5a5', 'b863412c-aad0-418a-b46b-b40793867e7c', '3df4f33a-8a2c-4927-af39-883245291610'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:20 devstack sudo[106588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:18:20 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:20 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.info" returned: 0 in 0.642s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:20 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.info is being set with open permissions: ugo+rw
Jul 04 00:18:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:20 devstack sudo[106591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.info
Jul 04 00:18:20 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:21 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.716s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:18:21 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Deleted volume successfully.
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-82f5d9ab-5ff1-49de-83c9-847a10f69f40 tempest-ProjectMemberTests-136049202 None] Lock "cinder-b2326911-8cec-4b9a-8e53-686860f9607d-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:21 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.info" returned: 0 in 0.705s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.592s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (911142fb-4aad-4a2b-9525-89f6f565abca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7920a406-5de1-46b5-bf41-9e0bb9f04d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:21 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-023227f1-f7a3-4ae7-8ee1-deb50aaf0143 tempest-ProjectReaderTests-1508998797 None] Create snapshot completed successfully
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7920a406-5de1-46b5-bf41-9e0bb9f04d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1790194440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ef76a0-26e0-4f95-8140-f774994f0969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:21Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e8b438-88b4-4bfe-bcb0-6037eaa2718d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8e8b438-88b4-4bfe-bcb0-6037eaa2718d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7f65ee-2909-46b5-98d0-9ff9417245f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7f65ee-2909-46b5-98d0-9ff9417245f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ef76a0-26e0-4f95-8140-f774994f0969', 'volume_name': 'volume-62ef76a0-26e0-4f95-8140-f774994f0969', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347c61e4-3318-4a90-82ef-6d3ad8718189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347c61e4-3318-4a90-82ef-6d3ad8718189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7246caa-b067-450c-85a2-381d13ecae51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:21 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Volume 62ef76a0-26e0-4f95-8140-f774994f0969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ef76a0-26e0-4f95-8140-f774994f0969', 'volume_size': 1}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1790194440',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62ef76a0-26e0-4f95-8140-f774994f0969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:21Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Creating volume 62ef76a0-26e0-4f95-8140-f774994f0969 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:18:21 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:18:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:21 devstack sudo[106595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969 1073741824
Jul 04 00:18:21 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-64f552f2-d3e3-4f28-8914-d833c9406ecb-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-64f552f2-d3e3-4f28-8914-d833c9406ecb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-quobyte-6eb790e1-c251-4b72-b007-6d62531fce53" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-6eb790e1-c251-4b72-b007-6d62531fce53" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-quobyte-64f552f2-d3e3-4f28-8914-d833c9406ecb" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:22 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-64f552f2-d3e3-4f28-8914-d833c9406ecb" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Deleting offline snapshot 64f552f2-d3e3-4f28-8914-d833c9406ecb of volume 6eb790e1-c251-4b72-b007-6d62531fce53 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:18:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] snapshot_file for this snap is: volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:18:22 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f36e3e-310e-4567-b1fb-f5792296ee3d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:22 devstack sudo[106600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb
Jul 04 00:18:22 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:22 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969 1073741824" returned: 0 in 0.889s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:22 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969
Jul 04 00:18:22 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:23 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb" returned: 0 in 0.833s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6eb790e1-c251-4b72-b007-6d62531fce53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0b85db-ae51-421c-a5f1-8c412d124de4]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:23 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969" returned: 0 in 0.646s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:23 devstack sudo[106609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53
Jul 04 00:18:23 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7246caa-b067-450c-85a2-381d13ecae51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ef76a0-26e0-4f95-8140-f774994f0969', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237c61c9-11f3-4a07-9f49-60835042f01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:23 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Volume volume-62ef76a0-26e0-4f95-8140-f774994f0969 (62ef76a0-26e0-4f95-8140-f774994f0969): created successfully
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237c61c9-11f3-4a07-9f49-60835042f01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (911142fb-4aad-4a2b-9525-89f6f565abca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:23 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-8a702c05-2675-47cc-a2b4-a4a84e1cab79 tempest-ProjectMemberTests-136049202 None] Created volume successfully.
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] Creating offline snapshot 0e37a7be-d755-45ae-a514-a8d9c77b4609 of volume 62ef76a0-26e0-4f95-8140-f774994f0969 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[368b7d98-2cc2-4b3c-ae89-be89d02d49ea]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:23 devstack sudo[106613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969
Jul 04 00:18:23 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:23 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53" returned: 0 in 0.818s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:23 devstack sudo[106616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb
Jul 04 00:18:23 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:24 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969" returned: 0 in 0.758s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:24 devstack sudo[106625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609 1G
Jul 04 00:18:24 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:24 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb" returned: 0 in 0.737s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:24 devstack sudo[106627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb
Jul 04 00:18:24 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:25 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53.64f552f2-d3e3-4f28-8914-d833c9406ecb" returned: 0 in 0.642s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:25 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-64f552f2-d3e3-4f28-8914-d833c9406ecb" released by "_delete_snapshot" :: held 3.124s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:25 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-6eb790e1-c251-4b72-b007-6d62531fce53" released by "delete_snapshot" :: held 3.156s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:25 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Created reservations ['2e4a617b-b309-4063-83df-3b918c4deafa', '9f632a0d-f3cd-4d67-9c3e-b2933028731a', '5131aec0-71e4-4ac4-b4e6-1fea1afd6a62', '21143357-0ee7-4bfa-a111-cf51147ef2c1'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:25 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609 1G" returned: 0 in 0.874s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ef76a0-26e0-4f95-8140-f774994f0969 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:25 devstack sudo[106633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ef76a0-26e0-4f95-8140-f774994f0969 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609
Jul 04 00:18:25 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:25 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Delete snapshot completed successfully.
Jul 04 00:18:25 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-da94b4fb-918d-4587-a9f7-7601af651f43 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-64f552f2-d3e3-4f28-8914-d833c9406ecb-delete_snapshot" released by "delete_snapshot" :: held 3.341s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:26 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ef76a0-26e0-4f95-8140-f774994f0969 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609" returned: 0 in 0.733s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:26 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609 is being set with open permissions: ugo+rw
Jul 04 00:18:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:26 devstack sudo[106638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609
Jul 04 00:18:26 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-6eb790e1-c251-4b72-b007-6d62531fce53-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-6eb790e1-c251-4b72-b007-6d62531fce53-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-quobyte-6eb790e1-c251-4b72-b007-6d62531fce53" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:26 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-6eb790e1-c251-4b72-b007-6d62531fce53" acquired by "delete_volume" :: waited 0.032s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:26 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb91099-7d76-4c6a-819d-9698f546496b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:26 devstack sudo[106641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53
Jul 04 00:18:26 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:26 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609" returned: 0 in 0.675s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:26 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.info
Jul 04 00:18:26 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:27 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53" returned: 0 in 0.845s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:27 devstack sudo[106650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53
Jul 04 00:18:27 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:27 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.info" returned: 0 in 0.645s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:27 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.info is being set with open permissions: ugo+rw
Jul 04 00:18:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:27 devstack sudo[106652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.info
Jul 04 00:18:27 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:28 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-6eb790e1-c251-4b72-b007-6d62531fce53" returned: 0 in 0.664s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:28 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-6eb790e1-c251-4b72-b007-6d62531fce53" released by "delete_volume" :: held 1.593s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:28 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Created reservations ['d440911d-67dd-4a83-aa53-b3c797c3db4b', '04f62dfb-296f-4a6c-9802-08a15adf412b', '0a3bcab6-a92e-4045-bef1-edd7ac68876a', '23791b38-1429-4c88-8d5e-52ebdcd8971b'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:28 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.info" returned: 0 in 0.721s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.492s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:28 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-862456f0-86ff-4043-aaaf-1b7978928e3f tempest-ProjectMemberTests-136049202 None] Create snapshot completed successfully
Jul 04 00:18:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:28 devstack sudo[106656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:18:28 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:28 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.681s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:28 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-0e37a7be-d755-45ae-a514-a8d9c77b4609-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:29 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Deleted volume successfully.
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Lock "cinder-0e37a7be-d755-45ae-a514-a8d9c77b4609-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-62ef76a0-26e0-4f95-8140-f774994f0969" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-230eadcb-fc49-42e3-a95b-6735766e2b30 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-6eb790e1-c251-4b72-b007-6d62531fce53-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-62ef76a0-26e0-4f95-8140-f774994f0969" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-0e37a7be-d755-45ae-a514-a8d9c77b4609" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-0e37a7be-d755-45ae-a514-a8d9c77b4609" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Deleting offline snapshot 0e37a7be-d755-45ae-a514-a8d9c77b4609 of volume 62ef76a0-26e0-4f95-8140-f774994f0969 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] snapshot_file for this snap is: volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba285c7-0f23-40dc-b3a6-b47c7263cebb]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Flow 'volume_create_manager' (a4edcd68-cdcc-45cd-b8bd-4f8eecf9fe73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22152b4-7838-4588-90fc-42dbfd04b0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c22152b4-7838-4588-90fc-42dbfd04b0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1446299562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5290120a-016e-4814-8056-f78081d82d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6d57aafba14c318bdb44162335bf67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:29Z,use_quota=True,user_id='1f14796bdcbd49d6a4b064ed1d4ddc57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144cea22-db91-4fec-8018-8ff3873dd231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144cea22-db91-4fec-8018-8ff3873dd231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:29 devstack sudo[106659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609
Jul 04 00:18:29 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3cf8b2-2971-41fa-bc7e-476778b4ffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a3cf8b2-2971-41fa-bc7e-476778b4ffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5290120a-016e-4814-8056-f78081d82d7d', 'volume_name': 'volume-5290120a-016e-4814-8056-f78081d82d7d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88736cf-f6ea-4929-9a2c-32f36c80a026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88736cf-f6ea-4929-9a2c-32f36c80a026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225d62b8-e9b4-448f-a880-92a7fe1236c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:29 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Volume 5290120a-016e-4814-8056-f78081d82d7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5290120a-016e-4814-8056-f78081d82d7d', 'volume_size': 1}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1446299562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5290120a-016e-4814-8056-f78081d82d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6d57aafba14c318bdb44162335bf67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:29Z,use_quota=True,user_id='1f14796bdcbd49d6a4b064ed1d4ddc57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Creating volume 5290120a-016e-4814-8056-f78081d82d7d {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:18:29 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:29 devstack sudo[106661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d 1073741824
Jul 04 00:18:29 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:29 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609" returned: 0 in 0.765s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62ef76a0-26e0-4f95-8140-f774994f0969(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[316bef44-e582-4f6a-9724-3c73582a8ba4]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:30 devstack sudo[106670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969
Jul 04 00:18:30 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:30 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d 1073741824" returned: 0 in 0.852s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:30 devstack sudo[106672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d
Jul 04 00:18:30 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:30 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969" returned: 0 in 0.814s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:30 devstack sudo[106678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609
Jul 04 00:18:30 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:30 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d" returned: 0 in 0.684s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:18:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (225d62b8-e9b4-448f-a880-92a7fe1236c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5290120a-016e-4814-8056-f78081d82d7d', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3e4321-eeef-4228-ba9c-6b96fb4446ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:30 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Volume volume-5290120a-016e-4814-8056-f78081d82d7d (5290120a-016e-4814-8056-f78081d82d7d): created successfully
Jul 04 00:18:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf3e4321-eeef-4228-ba9c-6b96fb4446ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:30 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Flow 'volume_create_manager' (a4edcd68-cdcc-45cd-b8bd-4f8eecf9fe73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:30 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-cf215680-e947-41e4-925b-634ebb8da165 tempest-ProjectReaderTests-1508998797 None] Created volume successfully.
Jul 04 00:18:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:31 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] Creating offline snapshot 0705caa2-a81b-46d7-b21b-32458df96532 of volume 5290120a-016e-4814-8056-f78081d82d7d {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:18:31 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae7591c-6bb9-43bf-ada5-8f25e8bdddc3]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:31 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609" returned: 0 in 0.787s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:31 devstack sudo[106684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609
Jul 04 00:18:31 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:31 devstack sudo[106683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d
Jul 04 00:18:31 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:32 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969.0e37a7be-d755-45ae-a514-a8d9c77b4609" returned: 0 in 0.653s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-0e37a7be-d755-45ae-a514-a8d9c77b4609" released by "_delete_snapshot" :: held 3.121s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-62ef76a0-26e0-4f95-8140-f774994f0969" released by "delete_snapshot" :: held 3.149s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:32 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d" returned: 0 in 0.792s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.0705caa2-a81b-46d7-b21b-32458df96532 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:32 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Created reservations ['d59ef48c-c0be-4adf-8bb8-0d8878c393c9', '18ad3846-8715-40fc-8802-d0c1c441e012', '4dabfd57-3cdd-4aed-b4a6-bf47615b9ad5', '9a235ec9-e6ad-4076-a599-96c82a8a9086'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:32 devstack sudo[106691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.0705caa2-a81b-46d7-b21b-32458df96532 1G
Jul 04 00:18:32 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:32 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Delete snapshot completed successfully.
Jul 04 00:18:32 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-15092637-eb75-4901-be97-b6326fa89f4d tempest-ProjectMemberTests-136049202 None] Lock "cinder-0e37a7be-d755-45ae-a514-a8d9c77b4609-delete_snapshot" released by "delete_snapshot" :: held 3.322s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:33 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.0705caa2-a81b-46d7-b21b-32458df96532 1G" returned: 0 in 0.795s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5290120a-016e-4814-8056-f78081d82d7d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.0705caa2-a81b-46d7-b21b-32458df96532 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:33 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5290120a-016e-4814-8056-f78081d82d7d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.0705caa2-a81b-46d7-b21b-32458df96532
Jul 04 00:18:33 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-62ef76a0-26e0-4f95-8140-f774994f0969-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Lock "cinder-62ef76a0-26e0-4f95-8140-f774994f0969-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-62ef76a0-26e0-4f95-8140-f774994f0969" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-62ef76a0-26e0-4f95-8140-f774994f0969" acquired by "delete_volume" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:33 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb48cb8-0a32-43cc-9721-f9788556f139]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:33 devstack sudo[106699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969
Jul 04 00:18:33 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:33 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5290120a-016e-4814-8056-f78081d82d7d -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.0705caa2-a81b-46d7-b21b-32458df96532" returned: 0 in 0.750s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:33 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.0705caa2-a81b-46d7-b21b-32458df96532 is being set with open permissions: ugo+rw
Jul 04 00:18:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.0705caa2-a81b-46d7-b21b-32458df96532 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:33 devstack sudo[106704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.0705caa2-a81b-46d7-b21b-32458df96532
Jul 04 00:18:33 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:34 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969" returned: 0 in 0.786s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:34 devstack sudo[106710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969
Jul 04 00:18:34 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:34 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.0705caa2-a81b-46d7-b21b-32458df96532" returned: 0 in 0.679s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:34 devstack sudo[106713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.info
Jul 04 00:18:34 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:34 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-62ef76a0-26e0-4f95-8140-f774994f0969" returned: 0 in 0.672s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-62ef76a0-26e0-4f95-8140-f774994f0969" released by "delete_volume" :: held 1.522s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:34 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Created reservations ['9d92c049-2277-4b7c-9985-213b6e5f7259', 'd6dbd14d-ff75-409b-97a4-acc698f32217', 'e5c558f9-a774-47ba-bf65-d1eb91160400', 'bcc056f4-0c9d-4fe1-ad7e-d44d539ff06f'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:34 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:35 devstack sudo[106716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:18:35 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:35 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.info" returned: 0 in 0.658s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:35 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.info is being set with open permissions: ugo+rw
Jul 04 00:18:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:35 devstack sudo[106719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.info
Jul 04 00:18:35 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:35 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.688s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:35 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:18:35 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Deleted volume successfully.
Jul 04 00:18:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9938a1d2-838f-4b16-a551-1458e42bffd0 tempest-ProjectMemberTests-136049202 None] Lock "cinder-62ef76a0-26e0-4f95-8140-f774994f0969-delete_volume" released by "delete_volume" :: held 2.422s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:35 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-5290120a-016e-4814-8056-f78081d82d7d.info" returned: 0 in 0.704s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.479s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:35 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-e117f0df-8777-4131-b90f-f8d0ea256728 tempest-ProjectReaderTests-1508998797 None] Create snapshot completed successfully
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (5132c5a3-3274-46e1-9721-3889c15ee065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68bad87-ce8b-4953-822a-1352f4c20aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e68bad87-ce8b-4953-822a-1352f4c20aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-104856022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:36Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120edb75-f3fd-4481-9b52-82844058d1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120edb75-f3fd-4481-9b52-82844058d1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9c0eea-4ea7-46fc-89f9-12f1b7b5f4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce9c0eea-4ea7-46fc-89f9-12f1b7b5f4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e', 'volume_name': 'volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895864ce-3f9c-462b-9d8b-0dbf9b539128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (895864ce-3f9c-462b-9d8b-0dbf9b539128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6247c1c-20d5-48a0-93dd-64b89f3765b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:36 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Volume b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e', 'volume_size': 1}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-104856022',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:36Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Creating volume b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:18:36 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:36 devstack sudo[106724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e 1073741824
Jul 04 00:18:36 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c63825f6-f073-4851-b27c-a9a97be947b9 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-0705caa2-a81b-46d7-b21b-32458df96532-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c63825f6-f073-4851-b27c-a9a97be947b9 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-0705caa2-a81b-46d7-b21b-32458df96532-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:36 devstack cinder-volume[86650]: INFO cinder.message.api [None req-c63825f6-f073-4851-b27c-a9a97be947b9 tempest-ProjectReaderTests-1508998797 None] Creating message record for request_id = req-c63825f6-f073-4851-b27c-a9a97be947b9
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c63825f6-f073-4851-b27c-a9a97be947b9 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-0705caa2-a81b-46d7-b21b-32458df96532-delete_snapshot" released by "delete_snapshot" :: held 0.046s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server [None req-c63825f6-f073-4851-b27c-a9a97be947b9 tempest-ProjectReaderTests-1508998797 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     skip_clean = func(self, context, snapshot, *args, **kwargs)
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     self.driver.unmanage_snapshot(snapshot)
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 04 00:18:36 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server 
Jul 04 00:18:36 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e 1073741824" returned: 0 in 0.852s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:37 devstack sudo[106730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e
Jul 04 00:18:37 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:37 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e" returned: 0 in 0.616s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:37 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:18:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6247c1c-20d5-48a0-93dd-64b89f3765b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3815e816-3e0d-4d22-9489-35304aeee750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:37 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Volume volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e (b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e): created successfully
Jul 04 00:18:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3815e816-3e0d-4d22-9489-35304aeee750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:37 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (5132c5a3-3274-46e1-9721-3889c15ee065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:37 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bea8aba4-c310-48dc-9e23-dac62990a4f1 tempest-ProjectMemberTests-136049202 None] Created volume successfully.
Jul 04 00:18:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:38 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] Creating offline snapshot 0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83 of volume b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:18:38 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b9d8c5-320b-425f-b31e-29fa1de47167]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:38 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e
Jul 04 00:18:38 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:39 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e" returned: 0 in 0.763s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:39 devstack sudo[106740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83 1G
Jul 04 00:18:39 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:39 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83 1G" returned: 0 in 0.813s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:39 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:39 devstack sudo[106746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83
Jul 04 00:18:39 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:40 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83" returned: 0 in 0.770s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:40 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83 is being set with open permissions: ugo+rw
Jul 04 00:18:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:40 devstack sudo[106752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83
Jul 04 00:18:40 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:41 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83" returned: 0 in 0.667s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:41 devstack sudo[106755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.info
Jul 04 00:18:41 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:42 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.info" returned: 0 in 0.684s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:42 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.info is being set with open permissions: ugo+rw
Jul 04 00:18:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:42 devstack sudo[106758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.info
Jul 04 00:18:42 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:42 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.info" returned: 0 in 0.663s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.452s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:42 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7f28cdef-7f42-4556-b87e-ac623b5a719a tempest-ProjectMemberTests-136049202 None] Create snapshot completed successfully
Jul 04 00:18:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Lock "cinder-0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:43 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Deleting offline snapshot 0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83 of volume b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:18:43 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] snapshot_file for this snap is: volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:18:43 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec3bb92-6225-4404-844c-0f1939472b9b]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:43 devstack sudo[106761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83
Jul 04 00:18:43 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:44 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83" returned: 0 in 0.827s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:18:44 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9ed52b-c188-40f2-90ef-3cafecb6ba79]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:44 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e
Jul 04 00:18:44 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:45 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e" returned: 0 in 0.809s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:45 devstack sudo[106772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83
Jul 04 00:18:45 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:45 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83" returned: 0 in 0.748s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:46 devstack sudo[106777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83
Jul 04 00:18:46 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:46 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e.0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83" returned: 0 in 0.705s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83" released by "_delete_snapshot" :: held 3.182s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e" released by "delete_snapshot" :: held 3.204s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:46 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Created reservations ['de929e82-bc66-4c21-9385-d5477f9e71a5', 'c76d0b4f-4f59-494f-9afb-cf810a30c153', '1e97d811-2a18-4849-a404-323d22e4f1ff', '08d0fb7a-5d10-4a55-a715-1badb6a44018'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:46 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Delete snapshot completed successfully.
Jul 04 00:18:46 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-d9258930-8596-4319-b9f2-3633c4e08f1e tempest-ProjectMemberTests-136049202 None] Lock "cinder-0c9b4036-fb9b-4b03-b5fb-d79ecb8c6a83-delete_snapshot" released by "delete_snapshot" :: held 3.340s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:47 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:47 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Lock "cinder-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:47 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:47 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:47 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1801fb7-942f-4f64-a7b3-5166f7689528]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:47 devstack sudo[106780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e
Jul 04 00:18:47 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:48 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e" returned: 0 in 0.752s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:48 devstack sudo[106785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e
Jul 04 00:18:48 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:49 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e" returned: 0 in 0.669s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e" released by "delete_volume" :: held 1.484s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:49 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=87,cinder:INSERT=29,cinder:UPDATE=100,cinder:DELETE=13 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:18:49 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Created reservations ['95cd7f89-c031-486d-a2ce-23941b3763ae', '0f83dda3-f128-432c-acd7-633309e7e1d1', '9d9336ca-a0a2-4fa4-bf3c-385f26553d61', 'fcc185c1-74ef-4ca1-b601-86c4040b6e83'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:18:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:49 devstack sudo[106788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:18:49 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:50 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.659s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:18:50 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Deleted volume successfully.
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=119,cinder:SELECT=97,cinder:DELETE=7,cinder:INSERT=34 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f1877ef4-d7e0-4d42-8e7d-1859de53eb77 tempest-ProjectMemberTests-136049202 None] Lock "cinder-b34d8ccd-0f7c-4ea7-8fc0-f51f5b893b4e-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (0538ff8f-f75a-4418-8dcf-3f963a03c796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a839283-b619-48fe-99d4-5f15b42546f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a839283-b619-48fe-99d4-5f15b42546f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2143202169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccaa0489-43b0-42cf-af54-d35453917dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:50Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a31b2c-749a-49f9-9ff9-a8a6f4884669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7a31b2c-749a-49f9-9ff9-a8a6f4884669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be6a475-615f-4d69-b76f-5a1f8608d5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0be6a475-615f-4d69-b76f-5a1f8608d5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccaa0489-43b0-42cf-af54-d35453917dce', 'volume_name': 'volume-ccaa0489-43b0-42cf-af54-d35453917dce', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801ba026-4c0e-4a1c-bac1-5dc81721531d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801ba026-4c0e-4a1c-bac1-5dc81721531d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4221992-cdfb-4b5b-806a-651403a295e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:50 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Volume ccaa0489-43b0-42cf-af54-d35453917dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccaa0489-43b0-42cf-af54-d35453917dce', 'volume_size': 1}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2143202169',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccaa0489-43b0-42cf-af54-d35453917dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:18:50Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Creating volume ccaa0489-43b0-42cf-af54-d35453917dce {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:18:50 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:18:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:50 devstack sudo[106791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce 1073741824
Jul 04 00:18:50 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:51 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce 1073741824" returned: 0 in 0.812s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:51 devstack sudo[106796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce
Jul 04 00:18:51 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:51 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce" returned: 0 in 0.638s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:51 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:18:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4221992-cdfb-4b5b-806a-651403a295e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccaa0489-43b0-42cf-af54-d35453917dce', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637cad1b-9ab6-4cab-8c1e-f91b1beac732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:18:51 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Volume volume-ccaa0489-43b0-42cf-af54-d35453917dce (ccaa0489-43b0-42cf-af54-d35453917dce): created successfully
Jul 04 00:18:51 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (637cad1b-9ab6-4cab-8c1e-f91b1beac732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:18:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (0538ff8f-f75a-4418-8dcf-3f963a03c796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:18:52 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ad9e9bd5-9b9f-4331-b0fd-d2c52a527d6d tempest-ProjectMemberTests-136049202 None] Created volume successfully.
Jul 04 00:18:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:18:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:18:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] Creating offline snapshot 12c64179-b296-47fc-93af-47a20852d443 of volume ccaa0489-43b0-42cf-af54-d35453917dce {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:18:52 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20a05ca-b03d-48e0-80c6-28700c6caa06]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:18:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:52 devstack sudo[106799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce
Jul 04 00:18:52 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:53 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce" returned: 0 in 0.742s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.12c64179-b296-47fc-93af-47a20852d443 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:53 devstack sudo[106804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.12c64179-b296-47fc-93af-47a20852d443 1G
Jul 04 00:18:53 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:54 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.12c64179-b296-47fc-93af-47a20852d443 1G" returned: 0 in 0.787s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccaa0489-43b0-42cf-af54-d35453917dce -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.12c64179-b296-47fc-93af-47a20852d443 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:54 devstack sudo[106811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccaa0489-43b0-42cf-af54-d35453917dce -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.12c64179-b296-47fc-93af-47a20852d443
Jul 04 00:18:54 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:54 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccaa0489-43b0-42cf-af54-d35453917dce -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.12c64179-b296-47fc-93af-47a20852d443" returned: 0 in 0.709s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:54 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.12c64179-b296-47fc-93af-47a20852d443 is being set with open permissions: ugo+rw
Jul 04 00:18:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.12c64179-b296-47fc-93af-47a20852d443 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:54 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.12c64179-b296-47fc-93af-47a20852d443
Jul 04 00:18:54 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:55 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.12c64179-b296-47fc-93af-47a20852d443" returned: 0 in 0.611s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:55 devstack sudo[106819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.info
Jul 04 00:18:55 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:56 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.info" returned: 0 in 0.662s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:56 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.info is being set with open permissions: ugo+rw
Jul 04 00:18:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:18:56 devstack sudo[106822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.info
Jul 04 00:18:56 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:18:56 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root
Jul 04 00:18:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ccaa0489-43b0-42cf-af54-d35453917dce.info" returned: 0 in 0.616s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:18:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.204s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:18:56 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-b41a916d-4fa6-4924-8f1d-d7a3fbd33e0c tempest-ProjectMemberTests-136049202 None] Create snapshot completed successfully
Jul 04 00:18:57 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-81f293db-1dd7-4f61-a426-174d3102c157 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-12c64179-b296-47fc-93af-47a20852d443-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:18:57 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-81f293db-1dd7-4f61-a426-174d3102c157 tempest-ProjectMemberTests-136049202 None] Lock "cinder-12c64179-b296-47fc-93af-47a20852d443-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:18:57 devstack cinder-volume[86650]: INFO cinder.message.api [None req-81f293db-1dd7-4f61-a426-174d3102c157 tempest-ProjectMemberTests-136049202 None] Creating message record for request_id = req-81f293db-1dd7-4f61-a426-174d3102c157
Jul 04 00:18:57 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-81f293db-1dd7-4f61-a426-174d3102c157 tempest-ProjectMemberTests-136049202 None] Lock "cinder-12c64179-b296-47fc-93af-47a20852d443-delete_snapshot" released by "delete_snapshot" :: held 0.037s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server [None req-81f293db-1dd7-4f61-a426-174d3102c157 tempest-ProjectMemberTests-136049202 None] Exception during message handling: AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 220, in wrapper
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     skip_clean = func(self, context, snapshot, *args, **kwargs)
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/decorator/__init__.py", line 247, in fun
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     return caller(func, *(extras + args), **kw)
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/coordination.py", line 234, in _synchronized
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     return f(*a, **k)
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1351, in delete_snapshot
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     raise self.value
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 1335, in delete_snapshot
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     self.driver.unmanage_snapshot(snapshot)
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server AttributeError: 'QuobyteDriver' object has no attribute 'unmanage_snapshot'. Did you mean: '_create_snapshot'?
Jul 04 00:18:57 devstack cinder-volume[86650]: ERROR oslo_messaging.rpc.server 
Jul 04 00:19:07 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=13,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:19:07 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:DELETE=1,cinder:INSERT=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:19:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:19:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:19:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:19:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:19:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:19:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:19:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:19:14 devstack sudo[106869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:19:14 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:19:15 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root
Jul 04 00:19:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.607s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:19:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:19:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:19:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:19:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:20:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:20:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:20:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:20:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:20:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:20:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:20:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:20:14 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:20:14 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:20:15 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Jul 04 00:20:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.639s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:20:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:20:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:20:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:20:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:20:17 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:21:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:21:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:21:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:21:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:21:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:21:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:21:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:21:14 devstack sudo[106983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:21:14 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:21:15 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root
Jul 04 00:21:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.618s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:21:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:21:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:21:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:21:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Flow 'volume_create_manager' (1b7393f4-f0e5-4c20-9767-b162bb132345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cee3b34-71a8-4586-bc7d-bca91d14987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cee3b34-71a8-4586-bc7d-bca91d14987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2052353582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7020bc-e5ab-4fb6-a140-b198fc432647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6d57aafba14c318bdb44162335bf67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:21:53Z,use_quota=True,user_id='1f14796bdcbd49d6a4b064ed1d4ddc57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14c0754-9ddb-4e02-b41e-fca571717465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f14c0754-9ddb-4e02-b41e-fca571717465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5579cd60-c6a4-45d1-9bbc-a6caa2f74bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5579cd60-c6a4-45d1-9bbc-a6caa2f74bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b7020bc-e5ab-4fb6-a140-b198fc432647', 'volume_name': 'volume-7b7020bc-e5ab-4fb6-a140-b198fc432647', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ae15cf-7a65-4df1-8c35-50699561aa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9ae15cf-7a65-4df1-8c35-50699561aa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca67fd3-6836-493d-862b-b862341301f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:21:52 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Volume 7b7020bc-e5ab-4fb6-a140-b198fc432647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b7020bc-e5ab-4fb6-a140-b198fc432647', 'volume_size': 1}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2052353582',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b7020bc-e5ab-4fb6-a140-b198fc432647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6d57aafba14c318bdb44162335bf67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:21:53Z,use_quota=True,user_id='1f14796bdcbd49d6a4b064ed1d4ddc57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Creating volume 7b7020bc-e5ab-4fb6-a140-b198fc432647 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:21:52 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:21:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:21:52 devstack sudo[106995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647 1073741824
Jul 04 00:21:52 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:21:53 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root
Jul 04 00:21:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647 1073741824" returned: 0 in 0.776s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:21:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:21:53 devstack sudo[107000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647
Jul 04 00:21:53 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:21:54 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root
Jul 04 00:21:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647" returned: 0 in 0.619s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:21:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:21:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:21:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ca67fd3-6836-493d-862b-b862341301f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b7020bc-e5ab-4fb6-a140-b198fc432647', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:21:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314803fe-82ac-460d-ab05-06b49d4ff308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:21:54 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Volume volume-7b7020bc-e5ab-4fb6-a140-b198fc432647 (7b7020bc-e5ab-4fb6-a140-b198fc432647): created successfully
Jul 04 00:21:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314803fe-82ac-460d-ab05-06b49d4ff308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:21:54 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Flow 'volume_create_manager' (1b7393f4-f0e5-4c20-9767-b162bb132345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:21:54 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-64a69dfa-1148-4e9a-b114-bceb7d8a7e37 tempest-ProjectReaderTests-1508998797 None] Created volume successfully.
Jul 04 00:21:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:21:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:21:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] Creating offline snapshot 8d16a230-ca70-4c24-a70d-7db705112d95 of volume 7b7020bc-e5ab-4fb6-a140-b198fc432647 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:21:54 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[54afca1c-770f-489a-91cf-e2b7055dcf58]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:21:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:21:54 devstack sudo[107004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647
Jul 04 00:21:54 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:21:55 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root
Jul 04 00:21:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647" returned: 0 in 0.723s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:21:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:21:55 devstack sudo[107009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95 1G
Jul 04 00:21:55 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:21:56 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root
Jul 04 00:21:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95 1G" returned: 0 in 0.759s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:21:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b7020bc-e5ab-4fb6-a140-b198fc432647 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:21:56 devstack sudo[107015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b7020bc-e5ab-4fb6-a140-b198fc432647 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95
Jul 04 00:21:56 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:21:56 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root
Jul 04 00:21:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b7020bc-e5ab-4fb6-a140-b198fc432647 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95" returned: 0 in 0.660s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:21:56 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95 is being set with open permissions: ugo+rw
Jul 04 00:21:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:21:56 devstack sudo[107021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95
Jul 04 00:21:56 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:21:57 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root
Jul 04 00:21:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95" returned: 0 in 0.619s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:21:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:21:57 devstack sudo[107024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.info
Jul 04 00:21:57 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:21:58 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root
Jul 04 00:21:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.info" returned: 0 in 0.625s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:21:58 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.info is being set with open permissions: ugo+rw
Jul 04 00:21:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:21:58 devstack sudo[107027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.info
Jul 04 00:21:58 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:21:58 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root
Jul 04 00:21:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.info" returned: 0 in 0.611s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:21:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.067s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:21:58 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-1affa655-186a-4557-99ac-5477816e3d8c tempest-ProjectReaderTests-1508998797 None] Create snapshot completed successfully
Jul 04 00:21:59 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-8d16a230-ca70-4c24-a70d-7db705112d95-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:00 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-8d16a230-ca70-4c24-a70d-7db705112d95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:00 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-quobyte-7b7020bc-e5ab-4fb6-a140-b198fc432647" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:00 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-7b7020bc-e5ab-4fb6-a140-b198fc432647" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:00 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-quobyte-8d16a230-ca70-4c24-a70d-7db705112d95" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:00 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-8d16a230-ca70-4c24-a70d-7db705112d95" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Deleting offline snapshot 8d16a230-ca70-4c24-a70d-7db705112d95 of volume 7b7020bc-e5ab-4fb6-a140-b198fc432647 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:22:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] snapshot_file for this snap is: volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:22:00 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[427091a2-c6ce-4130-9f1c-f277edf90683]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:00 devstack sudo[107072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95
Jul 04 00:22:00 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:00 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95" returned: 0 in 0.730s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:00 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b7020bc-e5ab-4fb6-a140-b198fc432647(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:22:00 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ef4a22-a704-469a-baed-3cd85f5a1160]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:00 devstack sudo[107077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647
Jul 04 00:22:00 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:01 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647" returned: 0 in 0.720s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:01 devstack sudo[107082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95
Jul 04 00:22:01 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:02 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95" returned: 0 in 0.700s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:02 devstack sudo[107087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95
Jul 04 00:22:02 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:02 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647.8d16a230-ca70-4c24-a70d-7db705112d95" returned: 0 in 0.658s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-8d16a230-ca70-4c24-a70d-7db705112d95" released by "_delete_snapshot" :: held 2.902s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-7b7020bc-e5ab-4fb6-a140-b198fc432647" released by "delete_snapshot" :: held 2.924s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:02 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Created reservations ['e4370e4d-a6eb-4d9c-ab5c-854ae7133727', '6d11ffc9-138a-4113-9f01-92345c8f6b4e', '0c878431-cd38-4e99-9e81-545215dd150e', '704f11c2-1c56-4c8d-9b4b-3b449ac053e7'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:22:03 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Delete snapshot completed successfully.
Jul 04 00:22:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c05b515b-b276-4142-ad7e-e8fa312f17a1 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-8d16a230-ca70-4c24-a70d-7db705112d95-delete_snapshot" released by "delete_snapshot" :: held 3.061s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-7b7020bc-e5ab-4fb6-a140-b198fc432647-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-7b7020bc-e5ab-4fb6-a140-b198fc432647-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-quobyte-7b7020bc-e5ab-4fb6-a140-b198fc432647" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:03 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-7b7020bc-e5ab-4fb6-a140-b198fc432647" acquired by "delete_volume" :: waited 0.014s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:03 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b515466b-261c-4a14-b92e-9b0373c52a79]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:03 devstack sudo[107090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647
Jul 04 00:22:03 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:04 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647" returned: 0 in 0.766s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:04 devstack sudo[107096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647
Jul 04 00:22:04 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:04 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-7b7020bc-e5ab-4fb6-a140-b198fc432647" returned: 0 in 0.611s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:04 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-7b7020bc-e5ab-4fb6-a140-b198fc432647" released by "delete_volume" :: held 1.436s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:04 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Created reservations ['df889411-a1c3-4656-8c7b-e5ec72a3f26b', '443bd007-5749-4d3b-8e03-fe0764015f04', '3cc87ca5-4511-48fa-80f8-eced86156684', 'bc55a358-e361-4921-a0fa-45ffc237d2f5'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:22:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:22:04 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:22:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:04 devstack sudo[107100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:22:04 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:05 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.689s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:22:05 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Deleted volume successfully.
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-3b8ae26e-18f8-4272-8ed1-6908847923e9 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-7b7020bc-e5ab-4fb6-a140-b198fc432647-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Flow 'volume_create_manager' (28cb6002-d598-48cb-9410-6f3b958be0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e54c711-e5db-422e-b909-09a96ae1168d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e54c711-e5db-422e-b909-09a96ae1168d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1348605428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6d57aafba14c318bdb44162335bf67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:22:06Z,use_quota=True,user_id='1f14796bdcbd49d6a4b064ed1d4ddc57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e70d60-fb4f-4074-a2fc-49f8ffc90965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e70d60-fb4f-4074-a2fc-49f8ffc90965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caea0c7-f90c-484e-9143-20ea38579ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3caea0c7-f90c-484e-9143-20ea38579ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6', 'volume_name': 'volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e4c5a5-44de-4f0b-abee-4105d1068664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e4c5a5-44de-4f0b-abee-4105d1068664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec491e61-e6ce-451d-a424-956e05ba47f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:05 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Volume bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6', 'volume_size': 1}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1348605428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6d57aafba14c318bdb44162335bf67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:22:06Z,use_quota=True,user_id='1f14796bdcbd49d6a4b064ed1d4ddc57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Creating volume bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:22:05 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:22:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:05 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6 1073741824
Jul 04 00:22:05 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:06 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6 1073741824" returned: 0 in 0.816s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:06 devstack sudo[107108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6
Jul 04 00:22:06 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:07 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6" returned: 0 in 0.647s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:22:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec491e61-e6ce-451d-a424-956e05ba47f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0312d7-5802-4f5c-99be-20ecddde3602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:07 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Volume volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6 (bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6): created successfully
Jul 04 00:22:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0312d7-5802-4f5c-99be-20ecddde3602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:07 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Flow 'volume_create_manager' (28cb6002-d598-48cb-9410-6f3b958be0fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:22:07 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-2fd45954-ec5e-4a5e-b0d6-047a794ba7a0 tempest-ProjectReaderTests-1508998797 None] Created volume successfully.
Jul 04 00:22:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] Creating offline snapshot 193dd2ac-8bac-4609-875a-1dca36131b4b of volume bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:22:08 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d8b098-8aaf-411a-bfd9-55bd3c0e2a97]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:08 devstack sudo[107111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6
Jul 04 00:22:08 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:08 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6" returned: 0 in 0.722s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:08 devstack sudo[107116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b 1G
Jul 04 00:22:08 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:09 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b 1G" returned: 0 in 0.791s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:09 devstack sudo[107121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b
Jul 04 00:22:09 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:10 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b" returned: 0 in 0.675s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:10 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b is being set with open permissions: ugo+rw
Jul 04 00:22:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:10 devstack sudo[107126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b
Jul 04 00:22:10 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:10 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b" returned: 0 in 0.605s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:10 devstack sudo[107129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.info
Jul 04 00:22:10 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:11 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.info" returned: 0 in 0.643s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:11 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.info is being set with open permissions: ugo+rw
Jul 04 00:22:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:11 devstack sudo[107132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.info
Jul 04 00:22:11 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:12 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.info" returned: 0 in 0.615s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.126s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:12 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7c2ae4fe-38f4-46ef-bb1a-d4138a817bb2 tempest-ProjectReaderTests-1508998797 None] Create snapshot completed successfully
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-193dd2ac-8bac-4609-875a-1dca36131b4b-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Lock "cinder-193dd2ac-8bac-4609-875a-1dca36131b4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-quobyte-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-quobyte-193dd2ac-8bac-4609-875a-1dca36131b4b" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-193dd2ac-8bac-4609-875a-1dca36131b4b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Deleting offline snapshot 193dd2ac-8bac-4609-875a-1dca36131b4b of volume bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] snapshot_file for this snap is: volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ca6cb7-5e1e-491e-aa6a-a6676286e650]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:13 devstack sudo[107135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b
Jul 04 00:22:13 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (8e087f1f-f754-46fb-9c80-bf636cb7068f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10694ed2-097c-4198-9b6b-025730a1efcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10694ed2-097c-4198-9b6b-025730a1efcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1349873641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619ced15-eaad-46a2-b10c-eac72272d065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:22:14Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba63e734-e498-4aa6-afcb-01a40833ae81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba63e734-e498-4aa6-afcb-01a40833ae81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c0cc42-72b5-4593-a580-5051aa08100f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10c0cc42-72b5-4593-a580-5051aa08100f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '619ced15-eaad-46a2-b10c-eac72272d065', 'volume_name': 'volume-619ced15-eaad-46a2-b10c-eac72272d065', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8cd918d-64a3-4226-be74-e55f1133bf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8cd918d-64a3-4226-be74-e55f1133bf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00118d1-6cff-43f5-b64e-049f2a4905eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:13 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Volume 619ced15-eaad-46a2-b10c-eac72272d065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-619ced15-eaad-46a2-b10c-eac72272d065', 'volume_size': 1}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1349873641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=619ced15-eaad-46a2-b10c-eac72272d065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:22:14Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Creating volume 619ced15-eaad-46a2-b10c-eac72272d065 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:22:13 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:22:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:13 devstack sudo[107137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065 1073741824
Jul 04 00:22:13 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:14 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b" returned: 0 in 0.748s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:22:14 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9c4551-0cb5-43a6-9307-e212d4fe059a]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:14 devstack sudo[107142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6
Jul 04 00:22:14 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:22:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:22:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:22:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:14 devstack sudo[107148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:22:14 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:14 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065 1073741824" returned: 0 in 0.915s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:14 devstack sudo[107154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065
Jul 04 00:22:14 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:14 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6" returned: 0 in 0.832s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:14 devstack sudo[107156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b
Jul 04 00:22:14 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:15 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.650s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:22:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:22:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:22:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:22:15 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065" returned: 0 in 0.671s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] <== create_volume: return (1636ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:22:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c00118d1-6cff-43f5-b64e-049f2a4905eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-619ced15-eaad-46a2-b10c-eac72272d065', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac11ad05-a5f5-4967-b985-bd6f6749d965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:15 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Volume volume-619ced15-eaad-46a2-b10c-eac72272d065 (619ced15-eaad-46a2-b10c-eac72272d065): created successfully
Jul 04 00:22:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac11ad05-a5f5-4967-b985-bd6f6749d965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (8e087f1f-f754-46fb-9c80-bf636cb7068f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:22:15 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-a6bda342-cfdb-4f0d-91dd-32c4c738c297 tempest-ProjectMemberTests-136049202 None] Created volume successfully.
Jul 04 00:22:15 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b" returned: 0 in 0.769s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:15 devstack sudo[107163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b
Jul 04 00:22:15 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:16 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] Creating offline snapshot 1a63bb3b-0ae6-4ab9-835e-8cd4f7730884 of volume 619ced15-eaad-46a2-b10c-eac72272d065 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:22:16 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb74269e-3ead-49d5-8ef3-7640c9743103]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:16 devstack sudo[107165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065
Jul 04 00:22:16 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:16 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6.193dd2ac-8bac-4609-875a-1dca36131b4b" returned: 0 in 0.647s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-193dd2ac-8bac-4609-875a-1dca36131b4b" released by "_delete_snapshot" :: held 3.100s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6" released by "delete_snapshot" :: held 3.124s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:16 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Created reservations ['acb17fd0-4621-436e-87b1-90192f238e66', 'f2e84097-95b0-47e8-be48-45b4050c5337', 'f6f016cc-7c53-4004-8450-551cf46fec98', 'b423f248-a341-415a-a137-fbaf8b4bde53'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:22:16 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Delete snapshot completed successfully.
Jul 04 00:22:16 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-ae09dfcb-8e9b-4b32-b94a-d2a35277dcfd tempest-ProjectReaderTests-1508998797 None] Lock "cinder-193dd2ac-8bac-4609-875a-1dca36131b4b-delete_snapshot" released by "delete_snapshot" :: held 3.250s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:16 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065" returned: 0 in 0.766s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:16 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884 1G
Jul 04 00:22:16 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Lock "cinder-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-quobyte-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:17 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6" acquired by "delete_volume" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:17 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e54535-f0d2-4414-9f74-13db63c3aada]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:17 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6
Jul 04 00:22:17 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:17 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884 1G" returned: 0 in 0.910s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-619ced15-eaad-46a2-b10c-eac72272d065 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:17 devstack sudo[107179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-619ced15-eaad-46a2-b10c-eac72272d065 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884
Jul 04 00:22:17 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:18 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6" returned: 0 in 0.802s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:18 devstack sudo[107187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6
Jul 04 00:22:18 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:18 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-619ced15-eaad-46a2-b10c-eac72272d065 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884" returned: 0 in 0.722s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:18 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884 is being set with open permissions: ugo+rw
Jul 04 00:22:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:18 devstack sudo[107189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884
Jul 04 00:22:18 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:19 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6" returned: 0 in 0.671s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6" released by "delete_volume" :: held 1.540s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:19 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Created reservations ['f5399129-e9be-4c1f-ac33-300fade9e9e6', '2e488585-0d85-4529-b2a4-860066ce38eb', 'daf9c392-e8c2-4342-8372-ece5e357874e', 'fdbd6a79-e0ec-4064-ba4b-63ff9394bfb1'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:22:19 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884" returned: 0 in 0.663s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:19 devstack sudo[107193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.info
Jul 04 00:22:19 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:22:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:22:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:19 devstack sudo[107195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:22:19 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:19 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.info" returned: 0 in 0.671s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:19 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.info is being set with open permissions: ugo+rw
Jul 04 00:22:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:19 devstack sudo[107199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.info
Jul 04 00:22:19 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:19 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.691s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:19 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:22:19 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Deleted volume successfully.
Jul 04 00:22:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-95adbc16-0d61-486b-85e8-b031404c641b tempest-ProjectReaderTests-1508998797 None] Lock "cinder-bc9c1cd0-5b2f-41d8-b4c2-dc50825535b6-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Flow 'volume_create_manager' (10c77efa-213c-42c0-b618-caa406fa9a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ccf45f3-38b4-4cdd-a550-5f531eb23da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ccf45f3-38b4-4cdd-a550-5f531eb23da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789269058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae14a30c-9499-4370-93ae-4354a8835459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6d57aafba14c318bdb44162335bf67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:22:20Z,use_quota=True,user_id='1f14796bdcbd49d6a4b064ed1d4ddc57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9cec76-f11d-434b-8d58-c66f308629e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de9cec76-f11d-434b-8d58-c66f308629e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167bad59-d992-4875-bee5-e47a017fe638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (167bad59-d992-4875-bee5-e47a017fe638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae14a30c-9499-4370-93ae-4354a8835459', 'volume_name': 'volume-ae14a30c-9499-4370-93ae-4354a8835459', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b3989c-a06a-48a4-9732-32649b434a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b3989c-a06a-48a4-9732-32649b434a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6927417f-e5b0-49e9-a9b5-6f3660258545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:20 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Volume ae14a30c-9499-4370-93ae-4354a8835459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae14a30c-9499-4370-93ae-4354a8835459', 'volume_size': 1}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:20 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.info" returned: 0 in 0.671s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.482s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.297s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789269058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae14a30c-9499-4370-93ae-4354a8835459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6d57aafba14c318bdb44162335bf67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:22:20Z,use_quota=True,user_id='1f14796bdcbd49d6a4b064ed1d4ddc57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Creating volume ae14a30c-9499-4370-93ae-4354a8835459 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:22:20 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:22:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:20 devstack sudo[107202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459 1073741824
Jul 04 00:22:20 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:20 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-bfab15eb-9700-4749-941a-521f1e230fa3 tempest-ProjectMemberTests-136049202 None] Create snapshot completed successfully
Jul 04 00:22:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-1a63bb3b-0ae6-4ab9-835e-8cd4f7730884-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Lock "cinder-1a63bb3b-0ae6-4ab9-835e-8cd4f7730884-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-619ced15-eaad-46a2-b10c-eac72272d065" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-619ced15-eaad-46a2-b10c-eac72272d065" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-1a63bb3b-0ae6-4ab9-835e-8cd4f7730884" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:21 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:21 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-1a63bb3b-0ae6-4ab9-835e-8cd4f7730884" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Deleting offline snapshot 1a63bb3b-0ae6-4ab9-835e-8cd4f7730884 of volume 619ced15-eaad-46a2-b10c-eac72272d065 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:22:21 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] snapshot_file for this snap is: volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:22:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459 1073741824" returned: 0 in 0.854s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:21 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce021a2c-8520-4b3b-8de8-b564615b0259]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:21 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:21 devstack sudo[107209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459
Jul 04 00:22:21 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:21 devstack sudo[107208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884
Jul 04 00:22:21 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:22 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459" returned: 0 in 0.622s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6927417f-e5b0-49e9-a9b5-6f3660258545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae14a30c-9499-4370-93ae-4354a8835459', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d71632-fa8f-4614-890e-849521a16937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:22 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Volume volume-ae14a30c-9499-4370-93ae-4354a8835459 (ae14a30c-9499-4370-93ae-4354a8835459): created successfully
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9d71632-fa8f-4614-890e-849521a16937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Flow 'volume_create_manager' (10c77efa-213c-42c0-b618-caa406fa9a63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:22:22 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-201be842-e861-49d6-a139-1d4b495e801d tempest-ProjectReaderTests-1508998797 None] Created volume successfully.
Jul 04 00:22:22 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884" returned: 0 in 0.770s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-619ced15-eaad-46a2-b10c-eac72272d065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0405467-34b8-4e5c-ac73-f58cf99b0be7]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:22 devstack sudo[107216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065
Jul 04 00:22:22 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] Creating offline snapshot 41ad85a7-eed2-4145-be1a-1f8de1bab03f of volume ae14a30c-9499-4370-93ae-4354a8835459 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cb16ec-4055-4b3f-8d9c-60cf22a597a2]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:22 devstack sudo[107218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459
Jul 04 00:22:22 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:22 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065" returned: 0 in 0.774s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:22 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:22 devstack sudo[107223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884
Jul 04 00:22:22 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:23 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459" returned: 0 in 0.767s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:23 devstack sudo[107228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f 1G
Jul 04 00:22:23 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:23 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884" returned: 0 in 0.752s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:23 devstack sudo[107236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884
Jul 04 00:22:23 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:23 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f 1G" returned: 0 in 0.779s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:23 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae14a30c-9499-4370-93ae-4354a8835459 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:23 devstack sudo[107239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae14a30c-9499-4370-93ae-4354a8835459 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f
Jul 04 00:22:23 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:24 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065.1a63bb3b-0ae6-4ab9-835e-8cd4f7730884" returned: 0 in 0.633s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-1a63bb3b-0ae6-4ab9-835e-8cd4f7730884" released by "_delete_snapshot" :: held 3.022s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-619ced15-eaad-46a2-b10c-eac72272d065" released by "delete_snapshot" :: held 3.046s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:24 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Created reservations ['b0b63cbe-98dc-4ce3-996a-e078658da334', '688ec9cc-513f-4274-852d-5e79ab73090e', 'f1ca1e47-a87d-44e5-b723-ec1b41bb110f', 'd3d231e1-4606-4796-94ee-2d2487809263'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:22:24 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Delete snapshot completed successfully.
Jul 04 00:22:24 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-c1de418d-caee-4a99-80cd-275ccc9428db tempest-ProjectMemberTests-136049202 None] Lock "cinder-1a63bb3b-0ae6-4ab9-835e-8cd4f7730884-delete_snapshot" released by "delete_snapshot" :: held 3.182s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:24 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae14a30c-9499-4370-93ae-4354a8835459 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f" returned: 0 in 0.700s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:24 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f is being set with open permissions: ugo+rw
Jul 04 00:22:24 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:24 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f
Jul 04 00:22:24 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:25 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f" returned: 0 in 0.669s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:25 devstack sudo[107249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.info
Jul 04 00:22:25 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:25 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-619ced15-eaad-46a2-b10c-eac72272d065-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:25 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Lock "cinder-619ced15-eaad-46a2-b10c-eac72272d065-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:25 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-619ced15-eaad-46a2-b10c-eac72272d065" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:25 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-619ced15-eaad-46a2-b10c-eac72272d065" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:25 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abd241f-7940-4347-97ef-2a43eebce1b7]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:25 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:25 devstack sudo[107251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065
Jul 04 00:22:25 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:26 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.info" returned: 0 in 0.665s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:26 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.info is being set with open permissions: ugo+rw
Jul 04 00:22:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:26 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.info
Jul 04 00:22:26 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:26 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065" returned: 0 in 0.769s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:26 devstack sudo[107259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065
Jul 04 00:22:26 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:26 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.info" returned: 0 in 0.626s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:26 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.291s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:26 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-931d7e2f-ba76-44b5-a28c-2bd3850daa75 tempest-ProjectReaderTests-1508998797 None] Create snapshot completed successfully
Jul 04 00:22:27 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-619ced15-eaad-46a2-b10c-eac72272d065" returned: 0 in 0.658s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-619ced15-eaad-46a2-b10c-eac72272d065" released by "delete_volume" :: held 1.493s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Created reservations ['a8d2d321-9c4b-4609-88c4-2246eecc0919', 'f421b09c-f069-4dd7-a43a-5b72ab0aaa31', '6ddd314f-3c08-4315-81a6-0008be854b6a', '919f2eac-225c-4d46-ae76-1f5f804c620e'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:27 devstack sudo[107263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:22:27 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-41ad85a7-eed2-4145-be1a-1f8de1bab03f-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Lock "cinder-41ad85a7-eed2-4145-be1a-1f8de1bab03f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-quobyte-ae14a30c-9499-4370-93ae-4354a8835459" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-ae14a30c-9499-4370-93ae-4354a8835459" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-quobyte-41ad85a7-eed2-4145-be1a-1f8de1bab03f" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-41ad85a7-eed2-4145-be1a-1f8de1bab03f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Deleting offline snapshot 41ad85a7-eed2-4145-be1a-1f8de1bab03f of volume ae14a30c-9499-4370-93ae-4354a8835459 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] snapshot_file for this snap is: volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[838169eb-c1c5-4453-a162-bf0218456a85]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:27 devstack sudo[107266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f
Jul 04 00:22:27 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:27 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.661s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:22:27 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Deleted volume successfully.
Jul 04 00:22:27 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-eddb43d8-8855-44a4-b80d-c0fcfd561519 tempest-ProjectMemberTests-136049202 None] Lock "cinder-619ced15-eaad-46a2-b10c-eac72272d065-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (a0688f96-814a-40dd-95d0-e2cff95143bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3601896c-52ac-4330-a1d8-067a37fb9bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3601896c-52ac-4330-a1d8-067a37fb9bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1604690082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371ab7b7-f673-4d16-850d-b89cb4d5311e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:22:28Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1674b2c2-55bb-4d55-86be-181d0a6d3f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1674b2c2-55bb-4d55-86be-181d0a6d3f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10efbb7-7816-4d03-9fde-6657ef46b327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c10efbb7-7816-4d03-9fde-6657ef46b327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '371ab7b7-f673-4d16-850d-b89cb4d5311e', 'volume_name': 'volume-371ab7b7-f673-4d16-850d-b89cb4d5311e', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ea8ca0-8c46-422c-b097-8445b87bbeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1ea8ca0-8c46-422c-b097-8445b87bbeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2379d6e5-8eda-47ee-bc71-b4c3e800b38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:28 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Volume 371ab7b7-f673-4d16-850d-b89cb4d5311e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-371ab7b7-f673-4d16-850d-b89cb4d5311e', 'volume_size': 1}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1604690082',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=371ab7b7-f673-4d16-850d-b89cb4d5311e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:22:28Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Creating volume 371ab7b7-f673-4d16-850d-b89cb4d5311e {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:22:28 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:28 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e 1073741824
Jul 04 00:22:28 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:28 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f" returned: 0 in 0.781s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae14a30c-9499-4370-93ae-4354a8835459(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[28528fb3-481c-4b2c-a9db-dc736908ba92]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:28 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:28 devstack sudo[107274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459
Jul 04 00:22:28 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:29 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e 1073741824" returned: 0 in 0.811s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:29 devstack sudo[107279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e
Jul 04 00:22:29 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:29 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459" returned: 0 in 0.794s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:29 devstack sudo[107284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f
Jul 04 00:22:29 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:29 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e" returned: 0 in 0.645s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:29 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:22:29 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2379d6e5-8eda-47ee-bc71-b4c3e800b38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-371ab7b7-f673-4d16-850d-b89cb4d5311e', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942ba515-5f25-4f46-8406-d93547cce9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:29 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Volume volume-371ab7b7-f673-4d16-850d-b89cb4d5311e (371ab7b7-f673-4d16-850d-b89cb4d5311e): created successfully
Jul 04 00:22:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942ba515-5f25-4f46-8406-d93547cce9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:29 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (a0688f96-814a-40dd-95d0-e2cff95143bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:22:29 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f4d78761-0948-47b2-85e4-6298229ca17d tempest-ProjectMemberTests-136049202 None] Created volume successfully.
Jul 04 00:22:30 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f" returned: 0 in 0.709s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:30 devstack sudo[107291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f
Jul 04 00:22:30 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:30 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] Creating offline snapshot 61a0610e-9c7b-4232-a1cc-0fb0fd740eb0 of volume 371ab7b7-f673-4d16-850d-b89cb4d5311e {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:22:30 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[332f26e2-6745-45e8-be55-0ec8bbbbe9ad]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:30 devstack sudo[107293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e
Jul 04 00:22:30 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:30 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:30 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459.41ad85a7-eed2-4145-be1a-1f8de1bab03f" returned: 0 in 0.640s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-41ad85a7-eed2-4145-be1a-1f8de1bab03f" released by "_delete_snapshot" :: held 3.038s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-ae14a30c-9499-4370-93ae-4354a8835459" released by "delete_snapshot" :: held 3.066s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:30 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Created reservations ['e60fa1c7-00e0-4c18-ba83-49a1d39a3c21', 'dec4dc7b-00f0-4e62-9441-eb63fd6c5658', 'e224feaf-2c40-4102-ba33-4152d37e022c', '6cd49df8-6250-4e90-bb72-d3feb2064f79'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:22:30 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Delete snapshot completed successfully.
Jul 04 00:22:30 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-22246898-4ad9-40f9-b374-91c02753f65f tempest-ProjectReaderTests-1508998797 None] Lock "cinder-41ad85a7-eed2-4145-be1a-1f8de1bab03f-delete_snapshot" released by "delete_snapshot" :: held 3.202s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:31 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e" returned: 0 in 0.738s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:31 devstack sudo[107299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0 1G
Jul 04 00:22:31 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-ae14a30c-9499-4370-93ae-4354a8835459-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-ae14a30c-9499-4370-93ae-4354a8835459-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "cinder-quobyte-ae14a30c-9499-4370-93ae-4354a8835459" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:31 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-ae14a30c-9499-4370-93ae-4354a8835459" acquired by "delete_volume" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:31 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ca4cce-8cb1-4141-888e-eb41d9ee9567]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:31 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:32 devstack sudo[107304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459
Jul 04 00:22:32 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:32 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0 1G" returned: 0 in 0.832s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371ab7b7-f673-4d16-850d-b89cb4d5311e -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:32 devstack sudo[107306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371ab7b7-f673-4d16-850d-b89cb4d5311e -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0
Jul 04 00:22:32 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:32 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459" returned: 0 in 0.741s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:32 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459
Jul 04 00:22:32 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:32 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-371ab7b7-f673-4d16-850d-b89cb4d5311e -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0" returned: 0 in 0.666s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:32 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0 is being set with open permissions: ugo+rw
Jul 04 00:22:32 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:32 devstack sudo[107316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0
Jul 04 00:22:32 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:33 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-ae14a30c-9499-4370-93ae-4354a8835459" returned: 0 in 0.623s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:33 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-quobyte-ae14a30c-9499-4370-93ae-4354a8835459" released by "delete_volume" :: held 1.426s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:33 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Created reservations ['df485699-3c62-423d-9b63-db8ba1970ddd', 'a4d22b76-6f3a-483d-a4bd-1fff1eef5d41', '2201e017-6f64-4bd7-8b60-3ed6ddae230c', 'e1e83c48-626d-45bf-9b71-6ee0d2365474'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:22:33 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0" returned: 0 in 0.654s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:33 devstack sudo[107320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.info
Jul 04 00:22:33 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:22:33 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:22:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:33 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:33 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:22:33 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:34 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.info" returned: 0 in 0.666s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:34 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.info is being set with open permissions: ugo+rw
Jul 04 00:22:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:34 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.642s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:34 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:22:34 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Deleted volume successfully.
Jul 04 00:22:34 devstack sudo[107326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.info
Jul 04 00:22:34 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:34 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f497f7cf-1e5e-418a-90cd-3180878301d1 tempest-ProjectReaderTests-1508998797 None] Lock "cinder-ae14a30c-9499-4370-93ae-4354a8835459-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:34 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.info" returned: 0 in 0.701s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:34 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.348s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:34 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-addd7426-e87f-49b5-a45d-e00fb70afeb1 tempest-ProjectMemberTests-136049202 None] Create snapshot completed successfully
Jul 04 00:22:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-61a0610e-9c7b-4232-a1cc-0fb0fd740eb0-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Lock "cinder-61a0610e-9c7b-4232-a1cc-0fb0fd740eb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-371ab7b7-f673-4d16-850d-b89cb4d5311e" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-371ab7b7-f673-4d16-850d-b89cb4d5311e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-61a0610e-9c7b-4232-a1cc-0fb0fd740eb0" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:35 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-61a0610e-9c7b-4232-a1cc-0fb0fd740eb0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Deleting offline snapshot 61a0610e-9c7b-4232-a1cc-0fb0fd740eb0 of volume 371ab7b7-f673-4d16-850d-b89cb4d5311e {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:22:35 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] snapshot_file for this snap is: volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:22:35 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e66dff-d35b-4808-b3a1-ae28480deba8]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:35 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:35 devstack sudo[107332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0
Jul 04 00:22:35 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:36 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0" returned: 0 in 0.746s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:36 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-371ab7b7-f673-4d16-850d-b89cb4d5311e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:22:36 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[69975459-ff4d-419b-8f2c-f7e8290001d0]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:36 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:36 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e
Jul 04 00:22:36 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:37 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e" returned: 0 in 0.788s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:37 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:37 devstack sudo[107342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0
Jul 04 00:22:37 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:38 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0" returned: 0 in 0.711s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:38 devstack sudo[107347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0
Jul 04 00:22:38 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:38 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:38 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e.61a0610e-9c7b-4232-a1cc-0fb0fd740eb0" returned: 0 in 0.666s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-61a0610e-9c7b-4232-a1cc-0fb0fd740eb0" released by "_delete_snapshot" :: held 3.023s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-371ab7b7-f673-4d16-850d-b89cb4d5311e" released by "delete_snapshot" :: held 3.046s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:38 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Created reservations ['94cd44b5-366a-4d48-88a1-73aa17972296', '32151dd5-57d5-4913-8842-f54fdb04835b', 'd350323c-2d90-4cee-a5af-78a34a8c0c07', '922b1548-15c2-4d5f-83a3-0a48921a8e76'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:22:38 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Delete snapshot completed successfully.
Jul 04 00:22:38 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6df99cb8-270c-4bd7-8c6e-1875c0f63a07 tempest-ProjectMemberTests-136049202 None] Lock "cinder-61a0610e-9c7b-4232-a1cc-0fb0fd740eb0-delete_snapshot" released by "delete_snapshot" :: held 3.243s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-371ab7b7-f673-4d16-850d-b89cb4d5311e-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:39 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Lock "cinder-371ab7b7-f673-4d16-850d-b89cb4d5311e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-371ab7b7-f673-4d16-850d-b89cb4d5311e" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:40 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-371ab7b7-f673-4d16-850d-b89cb4d5311e" acquired by "delete_volume" :: waited 0.014s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:40 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[31467037-b771-4404-a1b2-0be309c6f177]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:40 devstack sudo[107352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e
Jul 04 00:22:40 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:40 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e" returned: 0 in 0.765s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:40 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:40 devstack sudo[107357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e
Jul 04 00:22:40 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:41 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-371ab7b7-f673-4d16-850d-b89cb4d5311e" returned: 0 in 0.680s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:41 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-371ab7b7-f673-4d16-850d-b89cb4d5311e" released by "delete_volume" :: held 1.501s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:41 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Created reservations ['f35fac2e-59c5-4c03-83a0-e46c878610af', '26ea794b-a547-4a61-86d9-ff360c974fd5', 'f91014ca-65dd-45d7-b912-c64cfd0516ef', '042a259d-9307-49c2-a2b5-e47d4d12ea92'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:22:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:41 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:22:41 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:22:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:41 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:41 devstack sudo[107360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:22:41 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:42 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.676s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:22:42 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Deleted volume successfully.
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-9d68be4c-51cf-48e1-add6-16c411569556 tempest-ProjectMemberTests-136049202 None] Lock "cinder-371ab7b7-f673-4d16-850d-b89cb4d5311e-delete_volume" released by "delete_volume" :: held 2.375s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (c33c6d26-f7cf-41c7-909b-1bd4f2b52097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94191b8-f7d0-44a6-8cb9-20eff5f23ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94191b8-f7d0-44a6-8cb9-20eff5f23ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1163399827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc864531-b6d2-4196-9724-2d8f6311bb22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:22:43Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c85a74-f462-4b9c-a740-491ce8fbc713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66c85a74-f462-4b9c-a740-491ce8fbc713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b45274-aa46-4399-b5aa-e605cdac8344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02b45274-aa46-4399-b5aa-e605cdac8344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc864531-b6d2-4196-9724-2d8f6311bb22', 'volume_name': 'volume-cc864531-b6d2-4196-9724-2d8f6311bb22', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964bf36b-4c44-423a-a92d-4e2ad8d29970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964bf36b-4c44-423a-a92d-4e2ad8d29970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbee183a-e7c2-4cb9-89b4-7aad879d0547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:42 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Volume cc864531-b6d2-4196-9724-2d8f6311bb22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc864531-b6d2-4196-9724-2d8f6311bb22', 'volume_size': 1}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1163399827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc864531-b6d2-4196-9724-2d8f6311bb22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:22:43Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Creating volume cc864531-b6d2-4196-9724-2d8f6311bb22 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:22:42 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:22:42 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:42 devstack sudo[107363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22 1073741824
Jul 04 00:22:42 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:43 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22 1073741824" returned: 0 in 0.808s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:43 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:43 devstack sudo[107368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22
Jul 04 00:22:43 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:44 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22" returned: 0 in 0.624s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:22:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbee183a-e7c2-4cb9-89b4-7aad879d0547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc864531-b6d2-4196-9724-2d8f6311bb22', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320efb95-ba5f-459b-9a3e-31396492dd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:44 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Volume volume-cc864531-b6d2-4196-9724-2d8f6311bb22 (cc864531-b6d2-4196-9724-2d8f6311bb22): created successfully
Jul 04 00:22:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (320efb95-ba5f-459b-9a3e-31396492dd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:44 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (c33c6d26-f7cf-41c7-909b-1bd4f2b52097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:22:44 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-51a5eca1-e7e2-4d46-a0d8-3f780370d2fa tempest-ProjectMemberTests-136049202 None] Created volume successfully.
Jul 04 00:22:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:44 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] Creating offline snapshot 8c4294b9-552c-42e9-a0fc-af1858ec981c of volume cc864531-b6d2-4196-9724-2d8f6311bb22 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:22:44 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[650c2e7f-3738-4b60-9de0-7b3f11361c0e]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:44 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:45 devstack sudo[107372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22
Jul 04 00:22:45 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:45 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22" returned: 0 in 0.714s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:45 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:45 devstack sudo[107377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c 1G
Jul 04 00:22:45 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:46 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c 1G" returned: 0 in 0.761s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:46 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc864531-b6d2-4196-9724-2d8f6311bb22 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:46 devstack sudo[107382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc864531-b6d2-4196-9724-2d8f6311bb22 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c
Jul 04 00:22:46 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:47 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc864531-b6d2-4196-9724-2d8f6311bb22 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c" returned: 0 in 0.652s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:47 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c is being set with open permissions: ugo+rw
Jul 04 00:22:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:47 devstack sudo[107387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c
Jul 04 00:22:47 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:47 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c" returned: 0 in 0.623s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:47 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=70,cinder:UPDATE=90,cinder:INSERT=27,cinder:DELETE=12 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:22:47 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:47 devstack sudo[107390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.info
Jul 04 00:22:47 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:48 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.info" returned: 0 in 0.617s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:48 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.info is being set with open permissions: ugo+rw
Jul 04 00:22:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:48 devstack sudo[107393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.info
Jul 04 00:22:48 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:48 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.info" returned: 0 in 0.605s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:48 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.045s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:48 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-72c69d9a-0e42-4433-8c15-40ddf0836df0 tempest-ProjectMemberTests-136049202 None] Create snapshot completed successfully
Jul 04 00:22:48 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:UPDATE=99,cinder:SELECT=79,cinder:INSERT=25,cinder:DELETE=5 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:22:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-8c4294b9-552c-42e9-a0fc-af1858ec981c-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Lock "cinder-8c4294b9-552c-42e9-a0fc-af1858ec981c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-cc864531-b6d2-4196-9724-2d8f6311bb22" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-cc864531-b6d2-4196-9724-2d8f6311bb22" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-8c4294b9-552c-42e9-a0fc-af1858ec981c" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:49 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-8c4294b9-552c-42e9-a0fc-af1858ec981c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Deleting offline snapshot 8c4294b9-552c-42e9-a0fc-af1858ec981c of volume cc864531-b6d2-4196-9724-2d8f6311bb22 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:22:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] snapshot_file for this snap is: volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:22:49 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a39b4e6-48ef-4725-b97d-4e41eebe7251]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:49 devstack sudo[107396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c
Jul 04 00:22:49 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:49 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c" returned: 0 in 0.731s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:49 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc864531-b6d2-4196-9724-2d8f6311bb22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:22:49 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10aecc5-d697-4ebe-b8b6-213fa18e147d]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:49 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:50 devstack sudo[107401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22
Jul 04 00:22:50 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:50 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22" returned: 0 in 0.717s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:50 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:50 devstack sudo[107406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c
Jul 04 00:22:50 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:51 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c" returned: 0 in 0.690s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:51 devstack sudo[107411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c
Jul 04 00:22:51 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:51 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:51 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22.8c4294b9-552c-42e9-a0fc-af1858ec981c" returned: 0 in 0.611s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:51 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-8c4294b9-552c-42e9-a0fc-af1858ec981c" released by "_delete_snapshot" :: held 2.843s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:51 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-cc864531-b6d2-4196-9724-2d8f6311bb22" released by "delete_snapshot" :: held 2.864s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:52 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Created reservations ['d075eb31-9c9b-435a-b691-2e9c4c1fa709', '8e2c9133-f6d2-4332-9c9a-bf2e4700b1e5', '8f7b0845-d6aa-484f-8f7b-ef4ecfb72cec', 'c318465c-b91a-430f-a8e4-27e4124c12f6'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:22:52 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Delete snapshot completed successfully.
Jul 04 00:22:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-206badf8-c369-4737-8a3c-d1372e116e97 tempest-ProjectMemberTests-136049202 None] Lock "cinder-8c4294b9-552c-42e9-a0fc-af1858ec981c-delete_snapshot" released by "delete_snapshot" :: held 2.991s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-cc864531-b6d2-4196-9724-2d8f6311bb22-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Lock "cinder-cc864531-b6d2-4196-9724-2d8f6311bb22-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-cc864531-b6d2-4196-9724-2d8f6311bb22" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:22:52 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-cc864531-b6d2-4196-9724-2d8f6311bb22" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:22:52 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[975ad247-6720-48ba-b2d7-14374be09f96]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:52 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:52 devstack sudo[107414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22
Jul 04 00:22:52 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:53 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22" returned: 0 in 0.738s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:53 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:53 devstack sudo[107419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22
Jul 04 00:22:53 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:54 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-cc864531-b6d2-4196-9724-2d8f6311bb22" returned: 0 in 0.648s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-cc864531-b6d2-4196-9724-2d8f6311bb22" released by "delete_volume" :: held 1.442s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:54 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Created reservations ['c05317e3-b10d-463a-a2b7-3886a06eeb6c', 'c9f84c31-380b-4d67-8d1f-51a5def86655', '8203978f-5b5a-4566-addf-8719b0b55a92', 'a233e1dd-e848-40c6-8725-fa83b781111e'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:22:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:22:54 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:22:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:54 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:22:54 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:54 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:54 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.701s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:54 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:22:54 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Deleted volume successfully.
Jul 04 00:22:54 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-f3a672a7-4415-4ae9-9966-69252efabd0a tempest-ProjectMemberTests-136049202 None] Lock "cinder-cc864531-b6d2-4196-9724-2d8f6311bb22-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (8ee51dff-ce57-4cf0-9e64-436685df8373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c74a29-022a-4f70-aad9-a9779bbb4f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c74a29-022a-4f70-aad9-a9779bbb4f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1317784301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf70d5f-7ebc-4876-8ea9-b6af628d6b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:22:55Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4be7c40-0596-4269-bb7f-80c0a7845f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4be7c40-0596-4269-bb7f-80c0a7845f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa09f5c-5a7d-4cfa-b434-13f3cedcc22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa09f5c-5a7d-4cfa-b434-13f3cedcc22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caf70d5f-7ebc-4876-8ea9-b6af628d6b5c', 'volume_name': 'volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b293be83-dea9-4875-af59-a72f2f8b274a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b293be83-dea9-4875-af59-a72f2f8b274a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00591dc1-60ab-4f59-8348-1b7f520e4a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:55 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Volume caf70d5f-7ebc-4876-8ea9-b6af628d6b5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c', 'volume_size': 1}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1317784301',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf70d5f-7ebc-4876-8ea9-b6af628d6b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:22:55Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Creating volume caf70d5f-7ebc-4876-8ea9-b6af628d6b5c {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:22:55 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:22:55 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:55 devstack sudo[107426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c 1073741824
Jul 04 00:22:55 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:56 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c 1073741824" returned: 0 in 0.779s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:56 devstack sudo[107431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c
Jul 04 00:22:56 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:56 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c" returned: 0 in 0.630s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:56 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] <== create_volume: return (1447ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:22:56 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:22:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00591dc1-60ab-4f59-8348-1b7f520e4a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65577458-bdc6-4113-844f-cd06e524d70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:22:56 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Volume volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c (caf70d5f-7ebc-4876-8ea9-b6af628d6b5c): created successfully
Jul 04 00:22:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65577458-bdc6-4113-844f-cd06e524d70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:22:56 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (8ee51dff-ce57-4cf0-9e64-436685df8373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:22:56 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-0225b7a9-20b3-4576-8dcc-9dbdbb801d28 tempest-ProjectMemberTests-136049202 None] Created volume successfully.
Jul 04 00:22:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:22:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:22:57 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] Creating offline snapshot bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be of volume caf70d5f-7ebc-4876-8ea9-b6af628d6b5c {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:22:57 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[deafab9e-8121-462f-8b9f-cfdd168f15df]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:22:57 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:57 devstack sudo[107434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c
Jul 04 00:22:57 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:58 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c" returned: 0 in 0.725s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:58 devstack sudo[107439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be 1G
Jul 04 00:22:58 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:58 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be 1G" returned: 0 in 0.758s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:58 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:58 devstack sudo[107450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be
Jul 04 00:22:58 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:22:59 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root
Jul 04 00:22:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be" returned: 0 in 0.646s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:22:59 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be is being set with open permissions: ugo+rw
Jul 04 00:22:59 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:22:59 devstack sudo[107455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be
Jul 04 00:22:59 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:00 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be" returned: 0 in 0.642s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:00 devstack sudo[107494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.info
Jul 04 00:23:00 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:00 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.info" returned: 0 in 0.649s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:00 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.info is being set with open permissions: ugo+rw
Jul 04 00:23:00 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:00 devstack sudo[107497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.info
Jul 04 00:23:00 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:01 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.info" returned: 0 in 0.609s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:01 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.109s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:23:01 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-d2a58c01-780c-4bb3-89a4-3943cfb8018b tempest-ProjectMemberTests-136049202 None] Create snapshot completed successfully
Jul 04 00:23:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:23:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Lock "cinder-bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:23:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:23:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:23:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:23:02 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:23:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Deleting offline snapshot bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be of volume caf70d5f-7ebc-4876-8ea9-b6af628d6b5c {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:23:02 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] snapshot_file for this snap is: volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:23:02 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74ecde6-ad8b-4084-96cd-42bc084b42e5]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:23:02 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:02 devstack sudo[107500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be
Jul 04 00:23:02 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:03 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be" returned: 0 in 0.737s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:03 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:23:03 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b43fb5-7b6c-4026-add5-a24aeaa27074]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:23:03 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:03 devstack sudo[107505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c
Jul 04 00:23:03 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:04 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c" returned: 0 in 0.744s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:04 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:04 devstack sudo[107511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be
Jul 04 00:23:04 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:05 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be" returned: 0 in 0.698s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:05 devstack sudo[107516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be
Jul 04 00:23:05 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:05 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:05 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c.bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be" returned: 0 in 0.626s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be" released by "_delete_snapshot" :: held 2.894s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:23:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c" released by "delete_snapshot" :: held 2.914s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:23:05 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Created reservations ['ad81707e-2bab-47f7-bbf1-9b2959f348af', 'a6531d37-fc62-4a55-868e-e6509d054304', '24fe82c3-37d4-49b3-b8a4-b29d69cf1bc7', 'd4d87729-f96e-49a3-a38b-09f93db70854'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:23:05 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Delete snapshot completed successfully.
Jul 04 00:23:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-6616d5a3-a72f-4204-b9dd-f3a0e7a74251 tempest-ProjectMemberTests-136049202 None] Lock "cinder-bd5e27f0-c1f4-46ee-89d4-0bab8dfdb1be-delete_snapshot" released by "delete_snapshot" :: held 3.039s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:23:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:23:05 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Lock "cinder-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:23:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:23:06 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c" acquired by "delete_volume" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:23:06 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4590fb9-7b44-433d-b9df-746b702fc127]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:23:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:06 devstack sudo[107519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c
Jul 04 00:23:06 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:06 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c" returned: 0 in 0.720s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:06 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:06 devstack sudo[107524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c
Jul 04 00:23:06 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:07 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c" returned: 0 in 0.633s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:07 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c" released by "delete_volume" :: held 1.407s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:23:07 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Created reservations ['83a3b0d1-b818-4685-b073-1105adf78bb5', 'cc3a63e0-21b3-4134-8876-319c04af6679', '263b4870-20fa-42b9-91b6-4b2dcddbd312', 'e07b9a57-c805-460a-9f5d-b8f94a12449e'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:23:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:23:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:23:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:23:07 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:23:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:23:07 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:07 devstack sudo[107527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:23:07 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:08 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.616s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:23:08 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Deleted volume successfully.
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-4246a826-2236-4584-8f64-6a923479c4ac tempest-ProjectMemberTests-136049202 None] Lock "cinder-caf70d5f-7ebc-4876-8ea9-b6af628d6b5c-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86650) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (b7be45d0-ab74-4c4d-8b7f-a374f606f4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25eba100-15f7-4d4a-8ec0-398534fd340b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25eba100-15f7-4d4a-8ec0-398534fd340b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1828105650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2bb8a78-966a-458e-96a6-b36136daecc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:23:09Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74de781f-d59b-4aab-9b1a-29e3bf42674d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74de781f-d59b-4aab-9b1a-29e3bf42674d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c0a358-e72b-476f-9920-208d160a0cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58c0a358-e72b-476f-9920-208d160a0cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2bb8a78-966a-458e-96a6-b36136daecc8', 'volume_name': 'volume-a2bb8a78-966a-458e-96a6-b36136daecc8', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f640047-b26e-473a-9d3f-0b43dc2b9086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f640047-b26e-473a-9d3f-0b43dc2b9086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2127cc-144f-4ce4-bc1d-65bc373eee85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:23:08 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Volume a2bb8a78-966a-458e-96a6-b36136daecc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2bb8a78-966a-458e-96a6-b36136daecc8', 'volume_size': 1}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x75b00179b200>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-03T22:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1828105650',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2bb8a78-966a-458e-96a6-b36136daecc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6365798e52b94e71ba119dd29e4a77a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-03T22:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-03T22:23:09Z,use_quota=True,user_id='800855248cf04466b1817594e753b656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(914df0f9-aeaf-4c25-9221-9232c87cf214),volume_type_id=914df0f9-aeaf-4c25-9221-9232c87cf214)}" {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Creating volume a2bb8a78-966a-458e-96a6-b36136daecc8 {{(pid=86650) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Selected osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf as target Quobyte volume. {{(pid=86650) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 04 00:23:08 devstack cinder-volume[86650]: INFO cinder.volume.drivers.remotefs [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] casted to osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf
Jul 04 00:23:08 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8 1073741824 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:08 devstack sudo[107530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8 1073741824
Jul 04 00:23:08 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:09 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8 1073741824" returned: 0 in 0.791s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:09 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:09 devstack sudo[107535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8
Jul 04 00:23:09 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:10 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8" returned: 0 in 0.665s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'} {{(pid=86650) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 04 00:23:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:23:10 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f2127cc-144f-4ce4-bc1d-65bc373eee85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2bb8a78-966a-458e-96a6-b36136daecc8', 'volume_size': 1}' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:23:10 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95466685-b723-48d9-8d1b-064dd738d694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 04 00:23:10 devstack cinder-volume[86650]: INFO cinder.volume.flows.manager.create_volume [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Volume volume-a2bb8a78-966a-458e-96a6-b36136daecc8 (a2bb8a78-966a-458e-96a6-b36136daecc8): created successfully
Jul 04 00:23:10 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95466685-b723-48d9-8d1b-064dd738d694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86650) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 04 00:23:10 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Flow 'volume_create_manager' (b7be45d0-ab74-4c4d-8b7f-a374f606f4a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86650) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 04 00:23:10 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-aee3ce04-dadf-4c71-a6c0-8132afb78b2b tempest-ProjectMemberTests-136049202 None] Created volume successfully.
Jul 04 00:23:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:23:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:23:10 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] Creating offline snapshot f360e88d-12e8-49c7-9ac4-e7877a1fe513 of volume a2bb8a78-966a-458e-96a6-b36136daecc8 {{(pid=86650) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 04 00:23:10 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c09beb9-680c-4f3d-9062-0558bed995ee]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:23:10 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:10 devstack sudo[107538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8
Jul 04 00:23:10 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:11 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8" returned: 0 in 0.726s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:11 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513 1G {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:11 devstack sudo[107543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513 1G
Jul 04 00:23:11 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:12 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513 1G" returned: 0 in 0.758s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2bb8a78-966a-458e-96a6-b36136daecc8 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:12 devstack sudo[107549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2bb8a78-966a-458e-96a6-b36136daecc8 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513
Jul 04 00:23:12 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:12 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2bb8a78-966a-458e-96a6-b36136daecc8 -F qcow2 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513" returned: 0 in 0.654s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:12 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513 is being set with open permissions: ugo+rw
Jul 04 00:23:12 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:12 devstack sudo[107554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513
Jul 04 00:23:12 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:13 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513" returned: 0 in 0.607s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:13 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:13 devstack sudo[107557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.info
Jul 04 00:23:13 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:14 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.info" returned: 0 in 0.612s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:14 devstack cinder-volume[86650]: WARNING cinder.volume.drivers.remotefs [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.info is being set with open permissions: ugo+rw
Jul 04 00:23:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.info {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:14 devstack sudo[107560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.info
Jul 04 00:23:14 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:14 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:23:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:23:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:23:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:23:14 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:23:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:23:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:14 devstack sudo[107563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:23:14 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:14 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.info" returned: 0 in 0.613s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:14 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.052s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:23:14 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-7b4fad2c-2cda-4ad2-bd3b-9293513570e5 tempest-ProjectMemberTests-136049202 None] Create snapshot completed successfully
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-f360e88d-12e8-49c7-9ac4-e7877a1fe513-delete_snapshot" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Lock "cinder-f360e88d-12e8-49c7-9ac4-e7877a1fe513-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-a2bb8a78-966a-458e-96a6-b36136daecc8" by "delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-a2bb8a78-966a-458e-96a6-b36136daecc8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-f360e88d-12e8-49c7-9ac4-e7877a1fe513" by "_delete_snapshot" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:23:15 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-f360e88d-12e8-49c7-9ac4-e7877a1fe513" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Deleting offline snapshot f360e88d-12e8-49c7-9ac4-e7877a1fe513 of volume a2bb8a78-966a-458e-96a6-b36136daecc8 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] snapshot_file for this snap is: volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513 {{(pid=86650) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.677s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG oslo_service.periodic_task [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] Running periodic task VolumeManager._thread_info {{(pid=86650) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread count: 29 {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG cinder.volume.manager [None req-a9030471-43fe-4f15-9ad3-7c756481e946 None None] thread info: [<_MainThread(MainThread, started 129398909636736)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 129398798203648)>, <Thread(Thread-3 (stat_writer), started daemon 129398797177984)>, <Thread(Rabbit-heartbeat, started daemon 129398797963648)>, <Thread(Thread-5 (_runner), started daemon 129398796003840)>, <Thread(Thread-7 (_runner), started daemon 129398796061440)>, <Thread(fd_logger, started daemon 129398794175040)>, <Thread(privsep_reader, started daemon 129398794151360)>, <Thread(tpool_thread_0, started daemon 129398784280256)>, <Thread(tpool_thread_1, started daemon 129398775887552)>, <Thread(tpool_thread_2, started daemon 129398767494848)>, <Thread(tpool_thread_3, started daemon 129398759085760)>, <Thread(tpool_thread_4, started daemon 129398750676672)>, <Thread(tpool_thread_5, started daemon 129398742267584)>, <Thread(tpool_thread_6, started daemon 129398733858496)>, <Thread(tpool_thread_7, started daemon 129398725449408)>, <Thread(tpool_thread_8, started daemon 129398717040320)>, <Thread(tpool_thread_9, started daemon 129398708631232)>, <Thread(tpool_thread_10, started daemon 129398700222144)>, <Thread(tpool_thread_11, started daemon 129398691813056)>, <Thread(tpool_thread_12, started daemon 129398683403968)>, <Thread(tpool_thread_13, started daemon 129398674994880)>, <Thread(tpool_thread_14, started daemon 129398666585792)>, <Thread(tpool_thread_15, started daemon 129398658176704)>, <Thread(tpool_thread_16, started daemon 129398649767616)>, <Thread(tpool_thread_17, started daemon 129398641358528)>, <Thread(tpool_thread_18, started daemon 129398632949440)>, <Thread(tpool_thread_19, started daemon 129398624540352)>, <Thread(Rabbit-heartbeat, started daemon 129398787596160)>] {{(pid=86650) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1feb294-bd8b-43d7-bd33-9f77b2822cb0]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:15 devstack sudo[107567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513
Jul 04 00:23:15 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:15 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513" returned: 0 in 0.734s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.remotefs [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2bb8a78-966a-458e-96a6-b36136daecc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86650) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[4727f76d-94b1-45c4-8043-88dd554af2a4]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:23:15 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:16 devstack sudo[107572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8
Jul 04 00:23:16 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:16 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8" returned: 0 in 0.741s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:16 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:16 devstack sudo[107577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513
Jul 04 00:23:16 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:17 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513" returned: 0 in 0.715s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:17 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:17 devstack sudo[107582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513
Jul 04 00:23:17 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:18 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8.f360e88d-12e8-49c7-9ac4-e7877a1fe513" returned: 0 in 0.623s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-f360e88d-12e8-49c7-9ac4-e7877a1fe513" released by "_delete_snapshot" :: held 2.903s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:23:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-a2bb8a78-966a-458e-96a6-b36136daecc8" released by "delete_snapshot" :: held 2.925s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:23:18 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Created reservations ['1e3e69f1-809a-4fe7-863b-74885dde2d71', 'faaa2468-6f37-4c9e-b720-e06f73af6c61', '9f7e5229-e35b-4af0-aaed-04b6cd7ffa26', '8086f768-4e72-4af1-9bd3-fb745873e926'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:23:18 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Delete snapshot completed successfully.
Jul 04 00:23:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-8a395110-d014-4079-80c1-613e5096cc5d tempest-ProjectMemberTests-136049202 None] Lock "cinder-f360e88d-12e8-49c7-9ac4-e7877a1fe513-delete_snapshot" released by "delete_snapshot" :: held 3.058s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:23:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-a2bb8a78-966a-458e-96a6-b36136daecc8-delete_volume" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:23:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Lock "cinder-a2bb8a78-966a-458e-96a6-b36136daecc8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:23:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Acquiring lock "cinder-quobyte-a2bb8a78-966a-458e-96a6-b36136daecc8" by "delete_volume" {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 04 00:23:18 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-a2bb8a78-966a-458e-96a6-b36136daecc8" acquired by "delete_volume" :: waited 0.016s {{(pid=86650) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 04 00:23:18 devstack cinder-volume[86650]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c000af0-0f5c-4c65-aa5f-116f2e6d9019]: (4, 'qcow2') {{(pid=87748) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 04 00:23:18 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:18 devstack sudo[107585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8
Jul 04 00:23:18 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:19 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8" returned: 0 in 0.733s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8 {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:19 devstack sudo[107590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8
Jul 04 00:23:19 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:19 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d/volume-a2bb8a78-966a-458e-96a6-b36136daecc8" returned: 0 in 0.644s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:19 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Lock "cinder-quobyte-a2bb8a78-966a-458e-96a6-b36136daecc8" released by "delete_volume" :: held 1.434s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:23:19 devstack cinder-volume[86650]: DEBUG cinder.quota [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Created reservations ['155d331c-a173-416f-8636-b4b19628c406', 'f7accc4c-e49b-4db4-b2e8-2a4629aada78', 'e42f9b3c-5cd1-4cd6-ad2e-59892d580d55', '5aef3a95-2b70-46a0-9585-f4977f43fbc4'] {{(pid=86650) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 04 00:23:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 04 00:23:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 04 00:23:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf': None} {{(pid=86650) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 04 00:23:19 devstack cinder-volume[86650]: DEBUG cinder.volume.drivers.quobyte [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-23614859-cce3-4ab0-ba08-d371f6796faf'] {{(pid=86650) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 04 00:23:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.lockutils [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86650) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 04 00:23:19 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 04 00:23:19 devstack sudo[107593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d
Jul 04 00:23:19 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 04 00:23:20 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root
Jul 04 00:23:20 devstack cinder-volume[86650]: DEBUG oslo_concurrency.processutils [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/277a21b6be71cc24fd8f2eedb21f7d8d" returned: 0 in 0.620s {{(pid=86650) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 04 00:23:20 devstack cinder-volume[86650]: DEBUG cinder.manager [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Notifying Schedulers of capabilities ... {{(pid=86650) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 04 00:23:20 devstack cinder-volume[86650]: INFO cinder.volume.manager [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Deleted volume successfully.
Jul 04 00:23:20 devstack cinder-volume[86650]: DEBUG cinder.coordination [None req-615b59c3-8d80-4014-8733-4680ba1c47f3 tempest-ProjectMemberTests-136049202 None] Lock "cinder-a2bb8a78-966a-458e-96a6-b36136daecc8-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=86650) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 04 00:23:29 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=36,cinder:INSERT=15,cinder:UPDATE=47,cinder:DELETE=2 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 04 00:23:30 devstack cinder-volume[86650]: DEBUG dbcounter [-] [86650] Writing DB stats cinder:SELECT=40,cinder:UPDATE=53,cinder:INSERT=13,cinder:DELETE=5 {{(pid=86650) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}